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I.  INTRODUCTION 


A.  BACKGROUND  INFORMATION 

Simulations  are  used  for  many  purposes  in  the  military  including  that  of  training. 
In  any  simulation  that  requires  interaction  between  units  and  or  echelons  of  command 
some  modeling  of  communication  becomes  necessary.  For  many  simulations  human 
trainers  do  this  and  if  it  is  modeled  by  a  computer,  it  is  canned  text  which  is  the  same 
every  time  the  simulation  is  run.  This  same  problem  is  seen  in  the  electronic 
entertainment  industry,  especially  in  the  area  of  role  playing  games.  Role-playing  or 
adventure  games  are  those  where  the  player  controls  an  avatar  in  the  game  world  and 
interacts  with  people  and  objects  in  that  world  to  achieve  particular  goals.  The  game 
world  can  be  realistic  or  fantastic  but  the  type  of  interactions  can  be  directly  mapped  to 
military  simulations  of  various  types.  Since  these  games  share  the  same  problem  of 
predictable  interactions  with  simulations  it  makes  sense  to  leverage  the  accessibility  and 
scripting  capabilities  of  these  games  to  develop  a  generic  architecture  to  address  these 
problems  that  can  be  easily  adapted  to  both  program  types. 

Currently  missions  for  conventional  simulations  and  role  playing  games  have  to 
be  hard  coded  into  the  system  making  subsequent  iterations  predictable  thus  reducing  the 
training  value  and  enjoyment  factor  of  replaying  the  scenario  multiple  times.  As  of  now 
this  is  the  standard  approach  in  the  game  industry  making  most  role-playing  games  good 
for  only  a  single  time  through,  twice  if  the  player  goes  back  to  complete  the  side  quests. 
This  approach  also  consumes  huge  amounts  of  the  programmers’  time,  as  they  have  to 
script  each  of  the  possible  actions  and  story  line  branches.  A  better  alternative  would  be 
a  system  that  takes  information  about  the  environment  and  produces  possible  missions  for 
the  user  during  run  time.  This  would  allow  a  greatly  expanded  number  of  missions  for 
the  game  or  simulation  and  make  the  number  of  iterations  without  repeating  a  specific 
mission  much  greater. 

Examples  of  this  are  military  simulations  built  using  plug-ins  to  SSDS  and 
AEGIS  systems  for  the  USN  ships.  The  systems  can  be  put  into  a  training  mode  and 

have  simulated  land  masses  and  contacts  piped  directly  to  the  operators  screens  but  these 
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simulations  are  either  entered  manually  ahead  of  time  or  they  must  be  entered  at  runtime 
by  an  operator  working  behind  the  scenes  who  more  often  than  not  needs  the  training  just 
as  much  as  the  trainee.  Even  when  an  operator  runs  the  scenario,  in  order  to  ensure  all  of 
the  training  goals  are  met,  these  ‘red  forces’  are  often  working  off  of  a  script  that  is  just 
as  rigid  as  when  it  is  all  automated.  This  predictability  in  many  cases  causes  the  training 
value  of  the  exercise  to  degrade  because  the  trainees  know  what  is  going  to  happen  and 
when  it  will,  thus  making  the  training  session  more  akin  to  rehearsing  for  a  play  than 
anything  else.  It  does  little  to  prepare  the  trainees  for  what  they  must  do  when  faced  with 
a  truly  novel  situation. 

In  games,  this  problem  occurs  with  action  and  role-playing  games  such  as  the 
Final  Fantasy  series  or  Grand  Theft  Auto.  Despite  having  increasingly  large  virtual 
worlds  to  roam  in,  the  character  still  is  restricted  to  certain  storylines  with  that  require 
users  to  complete  very  specific  actions  in  order  to  progress.  The  Elder  Scrolls  series  does 
a  slightly  better  job  but  even  they  simply  give  the  player  more  possible  storylines 
allowing  the  player  to  ignore  the  primary  ones  if  desired.  Once  a  player  has  completed 
the  set  storylines  often  there  is  no  further  use  for  the  game  other  than  building  up 
characters  for  the  bragging  rights  involved. 

Massively  Multiplayer  Online  Games  (MMOG)  are  notorious  for  their  repetitive 
storylines.  Examples  of  this  are  EverQuest,  Asheron’s  Call,  and  the  extremely  popular 
World  of  Warcraft.  In  these  games  there  is  a  set  group  of  missions  hard  coded  into  the 
system  and  while  certain  missions  are  available  to  different  character  types,  those  never 
change.  Once  a  player  completes  all  current  missions,  there  is  nothing  new  for  the  player 
to  do,  until  the  developers  release  a  patch  with  new  content.  Significant  work  has  been 
done  on  the  automated  creation  of  testing  scenarios  for  various  computerized  systems  as 
well  as  the  creation  of  interactive  narratives.  Few  of  these  approaches  have  progressed 
past  the  academic  stage  though  as  they  are  too  large  and  unwieldy  for  commercial  use. 

One  of  the  main  problems  with  having  the  various  computer  controlled  non¬ 
player  characters  (NPCs)  create  new  missions  as  they  go  is  that  it  requires  that  the  agents 
hold  updated  knowledge  about  the  state  of  the  world  in  order  to  avoid  possible 

contradictions.  The  scalability  problems  related  to  trying  to  give  an  agent  a 
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comprehensive  knowledge  of  the  problem  space  is  immense.  To  have  every  agent  in  the 
world  carry  a  list  of  every  possible  threat  would  become  space  prohibitive  very  quickly 
and  the  idea  of  expanding  that  across  an  arbitrarily  large  virtual  world  brings  new 
meaning  to  the  phrase  ‘bloat  code’. 

Another  factor  that  reduces  the  believability  is  the  formulaic  manner  of  NPC 
speach  that  results  from  most  pattern  based  templates  for  the  generation  of  dialog.  An 
average  person  told  to  relate  a  piece  of  information  to  several  people  is  unlikely  to  use  the 
exact  same  syntax  in  every  instance  as  a  computer  generally  will.  Thus  a  certain  amount 
of  randomization  or  simply  a  greater  vocabulary  from  which  to  work  from  is  necessary. 
This  is  also  true  of  speaking  styles  among  people  of  various  social,  vocational,  and 
educational  strata.  Consequently,  varying  styles  of  speech  should  be  available  for  use  in 
order  to  make  the  computer-controlled  agents  more  believable  and  provide  a  greater 
sense  of  presence  in  the  user. 

A  second  point  of  contention  that  we  have  with  current  simulations  and  games  is 
the  way  the  attitudes  of  NPCs  towards  the  player  are  modeled.  Many  current  simulations 
and  computer  based  roleplaying  games  such  as  Neverwinter  Nights  and  World  of 
Warcraft  use  a  faction  system  to  model  the  attitudes  of  the  NPCs  towards  the  player. 
Under  this  system  each  person  is  assigned  an  allegiance  to  a  faction  that  exists  in  the 
game  world  and  every  person  that  belongs  to  that  faction  maintains  the  exact  same 
attitude  as  every  other  person  in  the  faction.  Some  games,  such  as  Eve  Online  have 
extended  the  idea  of  factions  and  assign  multiple  factions  to  each  NPC  and  use  a  simple 
equation  to  calculate  the  agents  overall  attitude  towards  the  player.  While  this  approach 
is  more  robust,  it  still  uses  a  single  set  function  to  determine  attitude  for  the  NPC  so  any 
agent  that  has  matching  demographics  (race,  corporation,  etc)  will  have  the  exact  same 
attitude  across  the  board  and  again  this  fails  to  take  personal  differences  into  account.  We 
find  this  global  unifonnity  in  attitude  to  go  against  common  sense. 

B.  PROBLEM  STATEMENT 

Systems  currently  have  to  make  the  tradeoff  between  the  number  of  unique 
scenarios  that  can  be  built  and  the  time  it  takes  to  produce  them  and  therefore  the  money 
spent  for  development.  This  same  problem  occurs  when  trying  to  update  a  system  to 
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include  new  threats  or  mission  objectives  after  it  is  already  in  use.  If  these  additions  are 
performed  automatically,  assuming  no  outside  human  intervention,  the  simulation  or 
game  must  inform  the  player  of  any  new  requirements.  This  requires  that  the  system  can 
create  comprehensible  dialog  at  run  time.  Simulations  and  games  for  the  most  part  also 
lack  the  ability  to  robustly  model  and  react  to  changing  attitudes  on  the  part  of  the  agents 
in  the  system  and  consequently  are  unable  to  react  to  user  actions  in  a  sufficiently 
complex  manner.  We  are  attempting  to  address  these  problems. 

C.  TECHNICAL  APPROACH 

We  created  an  architecture  that  uses  sentence  templates  and  libraries  of  sentence 
fragments  differentiated  by  NPC  type  to  create  dialog  at  run-time  that  is  appropriate  for 
whatever  interaction  is  currently  taking  place  between  the  player  and  the  NPC.  By 
defining  a  sentence  template  for  each  of  the  types  of  interactions  required  to  take  place 
between  the  player  and  the  NPCs,  we  allow  the  system  to  mix  and  match  sentence 
fragments  to  create  and  communicate  new  information  and  missions  on  the  fly  while 
keeping  the  system  small  enough  to  work  within  an  established  video  game  system. 

We  also  developed  an  alternate  method  for  determining  attitude  and  modifying  it 
at  run  time  with  minimal  computational  overhead  resulting  in  very  individualized 
responses  to  the  various  events  that  take  place  within  the  game  world.  To  do  this  we  use 
a  set  of  social  networks  that  represent  the  relationships  between  the  various  NPCs  in  the 
game  world.  We  first  show  that  this  is  possible  using  a  small  example  with  only  five 
people  in  our  game  world  and  then  expand  it  to  deal  with  a  village  of  twenty-eight  people 
to  show  that  the  system  still  works  on  a  larger  scale.  Development  time  issues  come  up 
as  the  number  of  agents  increases  but  this  will  be  addressed  when  we  discuss  the  system 
itself. 

The  program  Neverwinter  Nights  (NWN)  produced  by  Bioware  will  be  used  for 
proof  of  concept. 

D.  CONTRIBUTIONS 

We  did  not  attempt  to  solve  the  whole  problem  of  believable  narrative  creation  as 
that  is  well  beyond  the  scope  of  this  research  but  we  do  present  a  usable  architecture  that 
can  serve  as  a  middle  ground  between  that  and  the  conventional  approach  of  hard-coding 
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all  dialog.  Our  approach  to  modeling  social  interactions  among  NPCs  is  relatively  new 
and  though  we  are  aware  of  several  projects  moving  in  this  direction  particularly  dealing 
with  attempts  to  more  accurately  model  counterinsurgency  operations,  we  have  been 
unable  to  find  any  work  that  has  been  published  in  this  area.  We  believe  that  both  of 
these  could  greatly  improve  the  believability  and  replay  value  of  simulations  and  games 
such  as  those  currently  available  on  the  market. 
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II.  LITERATURE  REVIEW 


A.  INTERNAL  REPRESENTATION  OF  AGENT  KNOWLEDGE 

One  of  the  first  problems  is  finding  a  way  to  simply  represent  the  world  state  to 
the  agents  and  allow  them  to  be  cognizant  of  the  threats  that  they  would  be  both  aware  of 
and  would  be  interested  in.  It  is  impractical  to  attempt  to  represent  all  objects  in  the 
world  individually  as  this  quickly  becomes  untenable  as  the  system  scales  to  deal  with 
larger  and  larger  groups  of  entities. 

An  approach  for  representing  an  agents  internal  knowledge  of  the  state  of  the 
world  was  proposed  using  symbolic  preconditions  in  order  to  facilitate  planning  (Orkin). 
In  this  case  planning  means  that  the  computer  attempts  represents  the  world  as  a  set  of 
discrete  states  and  actions  that  will  change  the  current  world  state.  Each  action  has  a  set 
of  preconditions  that  must  be  met  prior  to  it  taking  place  and  a  set  of  results  that  happen 
as  a  consequence  of  that  action.  The  agent  is  then  able,  given  an  initial  world  state,  a  set 
of  possible  actions  it  can  perform,  and  a  desired  eventual  world  state  to  internally  plan  a 
string  of  actions  that  will  cause  the  world  to  change  from  its  current  state  to  a  state  that 
meets  with  the  agents  goals.  The  method  Orkin  used  was  to  allow  integers  to  represent 
abstract  states  using  a  minimal  number  of  symbols.  Instead  of  representing  all  of  the 
objects  in  the  world  and  their  status  they  used  a  single  pair  of  variables  to  describe  the 
current  threats  to  the  agent  thus  reducing  the  number  of  variables  required  to  represent 
the  states  and  make  planning  less  computationally  expensive.  This  approach  could  be 
easily  modified  for  use  in  the  NWN  framework  which  only  allows  integers,  floats,  and 
strings  in  its  agent  specific  and  global  variables  and  therefore  is  useful  when  trying  to 
represent  the  world  states  for  our  agents. 

B.  AUTOMATED  MISSION  GENERATION 

In  the  process  of  reviewing  the  available  literature  concerning  automated  mission 
generation  for  simulations  we  quickly  realized  that  very  little  had  been  published  on  this 
particular  area.  Most  games  use  largely  static  missions  to  drive  the  storyline 

One  game  that  currently  uses  a  system  that  demonstrates  some  of  the  behavior 
that  this  paper  proposes  is  the  MMOG,  EVE-Online.  The  mission  system  as  it  has  been 
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implemented  takes  a  set  of  mission  types,  ranging  from  the  infamous  “FEDEX”  quest 
that  consists  of  go  get  X  and  bring  it  to  Y  location,  to  missions  involving  gathering 
materials,  and  search  and  destroy  missions  targeting  possible  threats  from  groups  that  are 
considered  hostile  to  the  mission  giver.  The  missions  each  have  several  possible 
templates  where  the  location,  item,  enemy  type  and  force  size,  etc  are  variables  that  are 
entered  into  pre-generated  blocks  of  text  to  provide  a  basic  narrative  thread.  They  also 
include  “story-line”  quests  that  are  designed  to  give  the  player  a  look  at  the  back  story  to 
the  game  but  unlike  most  games  they  are  completely  voluntary.  While  this  allows  for 
much  greater  replayability,  after  a  while  the  player  begins  to  see  the  same  mission  texts 
again  and  again  and  it  becomes  repetitive.  This  is  an  improvement  on  the  traditional 
systems  but  not  a  solution. 

Historically,  story  graphs  could  be  used  where  all  possible  branches  the  story 
might  take  are  mapped  out  and  the  player  must  move  among  these  predefined  states  as 
they  progress  through  the  narrative.  This  is  somewhat  analogous  to  the  ‘choose  your  own 
adventure’  books  that  were  popular  on  the  ‘80s  and  while  it  provided  a  decent  level  of 
interactivity  there  were  relatively  few  different  storylines  possible.  There  is  also  the 
problem  that  in  many  situations  that  occur  in  a  story  there  are  multiple  ways  of  achieving 
a  given  goal  which  causes  even  more  possible  choices,  expanding  the  graph  even  more 
so.  To  demonstrate  the  problem,  assume  that  every  decision  point  in  a  story  graph  is 
simply  binary,  with  thirty  choices  in  the  storyline  (a  deceptively  small  number)  the  total 
number  of  nodes  necessary  to  map  out  the  story  space  would  be  2  or  1,073,741,824 
distinct  story  states  that  would  need  to  be  coded.  This  would  obviously  become  quickly 
untenable.  (Shaw)(Szilas  &  Rety) 

Another  approach  that  is  linked  to  AI  planning  techniques  is  the  idea  of  ‘story 
management’  where  the  graph  nodes  are  created  and  the  system  takes  the  past  events  into 
account  before  determining  the  next  possible  actions  for  the  player.  While  this  allows 
more  freedom  than  traditional  stories  it  still  requires  the  system  to  have  a  story  goal,  or  a 
conceptual  idea  of  what  the  player  should  be  doing  rather  than  allowing  the  character  to 
freely  move  through  the  environment  (Mateas)(Mateas  &  Stem  2003)(Mateas  &  Stern 
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2005).  This  style  of  approach  still  requires  an  overarching  storyline  and  is  therefore  too 
constrained  for  the  purposes  of  this  research. 

Osborn  approaches  the  problem  by  setting  no  boundaries  on  the  interactions  and 
giving  his  actors  instinctual  responses  to  stimuli.  He  uses  a  multi-agent  system  to  interact 
and  change  the  world  as  the  story  progresses.  While  this  would  produce  the  same  results 
as  the  system  we  are  proposing,  the  approach  seems  like  overkill,  tantamount  to  using  a 
thennonuclear  device  to  eliminate  an  anthill  (Osborn). 

One  final  approach  is  to  represent  the  storyline  of  a  game  as  a  probabilistic  model 
(Khan  &  Ward).  Khan  and  Ward  propose  that  a  Bayesian  model  can  be  used,  creating  a 
probabilistic  graph  where  the  nodes  are  the  various  worlds  states  and  the  arcs  are  possible 
player  actions  that  are  weighted  with  the  probability  of  a  player  choosing  to  take  that 
particular  action  as  opposed  to  the  other  possibilities.  These  probabilities  would  then 
allow  the  game  itself  to  react  and  present  options  that  it  reasons  are  more  in  line  with  the 
players  goals.  This  is  an  interesting  approach  but  we  don’t  see  it  as  necessary  to 
providing  the  basic  replayability  we  are  interested  in.  Especially  in  a  military  simulation 
when  as  often  as  not,  the  mission  givers  being  modeled  are  the  officers  in  command  of 
the  player  and  really  would  not  particularly  care  if  the  mission  was  to  the  liking  of  the 
player  as  long  as  it  got  completed  successfully.  This  approach  also  suffers  from  the 
requirement  of  an  overarching  storyline  and  is  therefore  not  viable. 

C.  AUTOMATED  DIALOG  GENERATION 

Quite  a  bit  of  research  has  been  conducted  on  automated  dialog  generation.  The 
most  common  way  I've  seen  that  this  is  approached  is  by  providing  templates,  often 
called  grammars,  with  blanks  the  computer  can  fill  in  from  its  knowledge  base  not  unlike 
the  idea  of  a  MadLib.  (Beaubouef)(Lonneker)(Shaw).  This  becomes  even  more  complex 
by  replacing  these  blanks  in  turn  with  templates  creating  a  theoretically  infinite  set  of 
choices.  Figure  1  shows  an  example  of  this  type  of  multiple  level  grammar. 
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<SUBJECT>  <VERB>  <PREDICATE> 


«PREP>  <ADJ>  <NOUN»  «ADV>  <VERB»  «  PREP>  <ADJ>  <NOUN» 

/  1  1 

«PREP>  <ADJ>  <NOUN»  «ADV>  <VERB»  «  PREP>  «ADJXAD»  <NOUN» 

Returns:  ’The  brown  dog  qmckly  chased  the  sleek  black  cat 

Figure  1.  Grammar  Template  Example 
This  research  proposes  to  use  a  similar  approach  matching  the  dialog  first  to  the  character 
type  and  then  to  the  mission  type  and  the  threat  at  hand.  Another  suggested  approach  is  to 
take  previously  created  stories  and  adapt  them  to  a  given  set  of  initial  constraints  using  a 
case-based-reasoning  approach  (Peinado  &  Gervas). 

A  possible  way  to  improve  on  this  system  is  examined  in  Reiter  and  Dale’s  look 
and  natural  language  generation  (NLG)  systems  (Reiter  &  Dale).  They  propose  a 
“corpus-based  approach”  where  the  designers  of  the  system  compile  a  set  of  all  of  the 
required  output  documents  which  they  call  an  “initial  corpus”  along  with  any  appropriate 
inputs  and  then  analyze  the  resulting  documents  to  try  and  identify  any  information 
present  that  is  not  readily  available  to  the  NLG.  This  should  leave  the  designers  with 
several  types  of  information;  text  that  does  not  change  between  iterations;  text  that  can  be 
directly  taken  from  the  knowledge  base;  text  that  can  be  derived  from  information  in  the 
knowledge  base;  and  information  that  is  not  available  in  the  knowledge  base.  The  first 
three  can  be  easily  identified  in  the  proposed  system  and  since  it  is  totally  automated  the 
last  case  will  have  to  be  carefully  omitted  to  avoid  invalid  or  incomplete  text  strings 
when  producing  the  NPCs  dialog.  The  authors  also  explore  the  necessary  components  in 
a  NLG  including  modules  for  ordering  the  words,  phrases,  and  sentences  and  ensuring 
that  the  proper  rules  of  grammar  are  imposed.  While  some  of  this  is  necessary,  in  some 
cases,  such  as  subcultures  or  uneducated  characters  conversing  with  the  PC,  certain  rules 
of  grammar  and  the  available  vocabulary  will  need  to  be  modified  to  fit  the  character  that 
is  speaking.  This  could  also  be  the  case  in  a  military  simulation  if  the  mission  dialog  is 
being  passed  to  the  user  by  various  agencies  that  use  different  phrases  or  acronyms  or 
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even  in  the  case  of  combined  missions  where  a  unit  is  receiving  information  from  a 
foreign  national.  In  the  proposed  system  the  NLG  in  our  scripts  will  have  to  be  able  to 
differentiate  between  various  mission  givers,  whom  may  not  all  communicate  in  the  same 
manner  depending  on  the  simulation.  This  differentiation  will  require  more  effort  up 
front  but  the  results  should  be  more  than  worth  it  in  character  believability. 

D.  SOCIAL  NETWORKS 

Our  first  exposure  to  the  idea  of  social  networks  was  in  fact  anecdotal  in  the  idea 
of  “Six  Degrees  of  Kevin  Bacon”.  This  is  a  game  where  an  actor  is  named  and  the 
players  must  connect  that  actor  to  Kevin  Bacon  through  people  he  has  starred  in  movies 
with.  This  is  based  on  an  experiment  conducted  by  Stanley  Milgram  in  1967  from  which 
he  concluded  that  any  person  in  the  world  is  connected  to  any  other  person  in  the  world 
by  way  of  a  string  of  personal  acquaintances.  The  idea  the  person  A  knows  person  B 
who  knows  person  C  and  so  on  until  you  reaching  person  X.  In  smaller  populations,  such 
as  actors  for  example,  approximately  six  jumps  are  needed  to  go  between  any  two  people 
in  a  population  (Wasserman  &  Faust).  This  led  us  to  the  idea  of  using  social  networks  to 
model  the  interactions  between  agents.  Despite  our  best  efforts  we  have  found  no 
research  indicating  that  anyone  else  has  attempted  to  use  social  networks  to  model  social 
interactions  inside  either  simulations  or  video  games. 

E.  CHOICE  OF  IMPLEMENTATION 

Our  choice  to  use  NWN  to  implement  our  system  was  not  arbitrary.  A  fair 
amount  of  academic  research  has  been  conducted  using  the  program  prior  to  our  choosing 
to  use  it.  This  is  mainly  due  to  the  well  supported  scripting  capabilities  that  are  provided 
with  the  game  and  the  large  coding  community  that  has  grown  up  over  the  years  allowing 
for  a  good  deal  of  help  when  learning  the  scripting  language  and  also  when  it  comes  to 
specific  problems  when  producing  code.  Several  large  collections  of  code  exist  free  for 
use  by  the  public  and  numerous  forums  exist  where  programmers  can  submit  questions  to 
be  answered  by  both  their  peers  and  the  developers  of  the  game  itself  (Bioware 
2004)(Bioware  2007).  Other  than  game  research,  NWN  has  been  used  by  the  Air  Force 
and  Army  to  conduct  studies  on  both  the  feasibility  of  using  COTS  video  games  to  build 
simulations  and  studying  the  in  personal  interactions  across  various  cultures  (Warren  et  al 
2004)(Warren  et  al  2005). 
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III.  GENERAL  SOLUTION 


A.  INTRODUCTION 

In  this  chapter  we  will  present  the  theoretical  architecture  for  both  our  mission 
and  dialog  generation  system  and  our  work  towards  using  social  networks  to  model 
complex  social  interactions  in  the  simulated  environment.  We  discuss  the  general 
method  in  which  we  propose  to  automate  communication  between  the  agents  and  the 
users.  We  also  show  the  mathematical  basis  behind  our  approach  to  the  use  of  social 
networks.  The  actual  implementation  of  these  ideas  are  not  presented  until  Chapter  V. 

B.  MISSION  AND  DIALOG  GENERATION 

The  general  architecture  proposed  to  automate  the  generation  of  both  missions 
and  dialog  is  made  up  of  two  integrated  parts.  The  first  is  the  automated  registering  of 
objects  so  they  are  capable  of  being  aware  of  each  other  without  extensive  work  on  the 
part  of  the  developer.  The  second  is  the  mission  and  dialog  generator  that  takes  inputs 
from  the  entities  and  the  world  to  produce  tasking  and  information  for  the  user.  A  basic 
line  diagram  of  the  architecture  is  provided  in  Figure  2  below. 


Figure  2.  Basic  Architecture  Line  Diagram 


The  registering  of  the  various  objects,  be  they  actors  or  items  of  interest,  is  done 
programmatically.  This  however  requires  that  a  strict  naming  convention  be  imposed  on 
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all  objects  in  the  system.  If  the  simulation  is  done  in  an  object  oriented  programming 
language  then  the  use  of  inheritance  can  be  leveraged  to  allow  a  single  function  to 
register  any  object  type.  During  registration  the  object  provides  the  world  object  with  its 
type,  unique  tag,  spawn  location,  and  its  notoriety,  a  measure  of  how  obvious  it  is  to  the 
rest  of  the  world.  When  an  object  is  removed  from  the  world  it  runs  a  script  that  removes 
its  data  from  the  worlds  database.  This  clean  up  is  necessary  in  order  to  allow  the  system 
to  create  new  objects  in  the  world  after  others  are  removed. 

The  agents  that  interact  with  the  user  are  each  given  a  scenario  specific  name, 
type,  list  of  areas  of  interest,  list  of  threats  of  interest,  and  knowledge  level  when  they  are 
created.  In  the  mission  and  dialog  generator  the  phrases  that  are  used  to  fill  in  the 
sentence  templates  are  drawn  from  a  phrase  library  that  is  divided  up  by  agent  type. 

Both  missions  and  simple  infonnative  dialog  can  be  generalized  into  the  idea  of 
sentence  templates  since  in  either  case  the  system  is  required  to  communicate  with  the 
user.  For  example,  “There  is  a  soldier  in  the  woods”  and  “Go  kill  the  soldier  in  the 
woods”  both  use  the  same  pieces  of  information  from  the  world  state  and  can  be 
generated  by  our  architecture  in  the  same  manner  but  the  first  is  simply  infonning  the 
player  and  the  second  is  issuing  a  command,  assigning  a  mission  if  you  will.  The  mission 
and  dialog  generator  works  by  taking  as  inputs  the  agents  type  and  knowledge  level, 
accessing  the  appropriate  sentence  template  and  filling  in  each  part  of  the  template  with 
an  appropriate  phrase  from  the  phrase  library.  If  multiple  equivalent  phrases  are 
programmed  into  the  library  then  the  draw  from  the  library  can  be  randomized  so  even  if 
asking  the  same  agent  the  same  question,  the  user  will  get  the  same  infonnation  but  the 
response  will  be  worded  in  a  slightly  different  fashion  each  time.  This  provides  more 
variety  in  the  conversation  in  keeping  with  the  goal  of  making  the  dialog  more 
believable. 

In  picking  the  type  of  sentence  that  is  appropriate  the  agent  type  is  taken  into 
account  and  from  the  set  of  all  possible  sentences,  only  types  that  the  agent  has  access  to 
are  considered.  A  heuristic  of  some  sort  can  be  used  to  decide  which  sentences  are  used 
or  it  could  be  as  simple  as  a  random  draw. 
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The  use  of  templates  and  agent  type  specific  phrase  libraries  makes  the  entire 
system  modular  allowing  a  developer  to  quickly  insert  new  agents  and  even  agent  types 
into  the  system.  Rather  than  having  to  reconstruct  entire  conversations  for  each  agent  in 
the  system  a  developer  can  simply  assign  a  type  and  knowledge  level  to  the  agent  and  the 
conversation  is  created  programmatically  at  run-time.  It  is  true  that  a  similar  time 
savings  could  be  obtained  in  many  systems  simply  by  cutting  and  pasting  a  conversation 
from  one  agent  file  to  another  but  this  would  provide  identical  static  conversations.  The 
proposed  system  creates  dynamic  conversations  that  would  differ  from  agent  to  agent  and 
between  conversation  instances.  This  modular  approach  makes  it  easy  to  change  the 
language  used  by  the  agents  as  well.  The  same  agent  infonnation  could  be  used  but  by 
switching  the  sentence  templates  and  phrase  libraries  it  is  possible  to  switch  from  English 
speaking  agents  to  Arabic  speaking  agents  fairly  simply.  If  the  grammar  is  similar 
enough  then  even  the  sentence  templates  could  conceivably  remain  the  same, 
consequently  it  becomes  simply  a  matter  of  changing  the  phrase  libraries  to  switch  the 
dialect  the  agents  are  using.  A  possible  example  of  this  would  be  switching  the 
simulation  from  speaking  Mandarin  to  Cantonese  for  instance.  Assuming  that  both 
dialects  of  Chinese  have  the  same  basic  grammar  then  the  only  differences  should  be  the 
vocabulary. 

C.  SOCIAL  NETWORKS 

We  also  propose  an  alternate  method  for  detennining  an  agent’s  attitude  towards 
the  user  and  modifying  it  at  run  time  with  minimal  computational  overhead  resulting  in 
very  individualized  responses  to  the  various  events  that  take  place  within  the  game  world. 
To  do  this  we  develop  a  set  of  social  networks  that  each  represent  the  relationships 
between  the  various  NPCs  in  the  game  world. 

Initially  we  considered  representing  each  of  the  social  networks  as  a  bidirectional 
graph  where  the  nodes  each  represent  an  agent  in  the  world  and  each  arc  shows  the  effect 
that  agent  has  on  the  agents  it  comes  in  contact  with  and  visa  versa.  An  event  would 
have  an  effect  on  a  particular  agent  and  then  the  effect  would  diffuse  outward  from  the 
initial  agent.  Unfortunately  this  approach  makes  second  and  higher  order  effects  and 
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loops  in  the  graph  difficult  to  deal  with.  While  we  found  that  these  difficulties  could  be 
overcome,  the  solutions  would  be  computationally  expensive. 

Instead  we  came  up  with  an  alternate  solution.  Each  of  the  social  networks  can  be 
represented  as  a  fully  connected  bidirectional  graph  where  arcs  that  are  not  in  the  non- 
fully  connected  graph  simply  have  a  weight  of  zero.  This  can  then  be  represented  as  an  n 
by  n  matrix  designated  as  Ak;  each  element  (axy)  represents  the  influence  agent  x  has 
upon  agent  y  and  where  n  is  the  number  of  entities  in  the  game  world  and  k  is  the  number 
of  networks  described  by  the  game  world  developer.  In  this  case  influence  is  defined  as 
the  effect  a  change  in  agent  x’s  attitude  towards  the  user  has  upon  the  attitude  of  agent  y 
towards  the  user.  Each  entry  in  the  matrix  has  been  set  as  a  value  between  -1  and  1 
inclusive.  This  bounding  ensures  that  the  value  of  each  subsequent  iteration  through  the 
network  will  have  less  effect  than  the  iteration  before  it.  Examples  of  these  networks 
would  be  family  connections,  networks  of  friends,  coworkers,  etc.  These  matrices  are 
then  combined  into  a  single  matrix  using  a  weighting  function  and  then  nonnalized. 
Matrix  B  is  the  amount  of  influence  the  personal  effects  of  an  event  has  on  the  agent  in 
question  and  as  such  only  has  entries  on  the  diagonal.  This  is  done  such  that  the  sum  of 
the  absolute  value  of  each  entry  in  any  particular  row  of  the  sum  of  matrices  A  and  B  is 
equal  to  one  as  shown  in  Figure  3. 
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Figure  3.  Influence  Matrices 
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We  chose  to  use  a  simple  linear  weighting  function  where  the  influence  of  each 
network  on  each  person  was  detennined  individually  but  a  more  complicated  function  for 
modeling  the  contribution  of  each  network  could  easily  be  substituted.  This  is  shown  in 
Figure  4.  The  normalization  of  each  network  is  accomplished  by  dividing  each  entry  by 
the  total  of  the  summation  of  the  absolute  value  of  each  entry  in  that  row. 

A  =  wl  Al  +  w2A2  + . . .  +  wkAk 
wnl+wn2  +  ...  +  wnk  +  wnB  =  \ 

B  =  wbI 

Figure  4.  Weighting  Equations 

In  the  initial  equation  the  LHS  x  vector  is  the  new  change  in  attitude  and  the  RHS 
x  vector  is  the  change  at  an  earlier  iteration  through  the  equation.  The  u  vector  represents 
the  initial  effects  that  a  given  event  would  have  on  each  of  the  entities  in  the  system.  In 
both  the  x  and  the  u  vectors,  each  row  represents  the  effect  on  an  entity  and  corresponds 
to  the  same  entity-row  pairs  in  the  A  and  B  matrices.  Given  this  equation  we  could  then 
iterate  through,  constantly  updating  the  x  vector  as  it  changed  over  time  but  this  leads  to 
the  problem  of  when  to  stop  iterating.  Rather  than  doing  multiple  iterations  and  not 
necessarily  knowing  when  another  iteration  would  no  longer  be  significant,  we  solved  the 
equation  for  x  as  shown  in  Figure  5. 


x  =  Ax  +  Bu 
(I  -  A)x  =  Bu 
x  =  (/  -  Ay1  Bu 

Figure  5.  Solving  for  x  Vector 

By  developing  a  layered  set  of  social  networks  offline  for  the  various  agents  in  the 

game  world  prior  to  run  time  we  can  calculate  the  change  in  attitude  of  any  particular 

agent  (x)  in  the  game  world  for  a  given  event  (u)  through  what  turns  out  to  be  a  simple 

vector-matrix  multiplication.  If  the  events  are  predetennined  then  all  of  the  attitude 

changes  can  be  precalculated  and  then  simply  added  to  the  agent’s  attitude  value  at  run 
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time.  This  information  could  then  be  fed  into  the  dialog  generator  described  above  and 
the  tone  or  even  the  content  of  the  communications  from  the  agent  could  be  modified  at 
run  time  dependent  on  the  agent’s  attitude  towards  the  user. 

The  main  difficulty  with  this  approach  is  that  it  requires  a  large  initial  investment 
of  time  and  effort  during  development.  Rather  than  simply  assigning  a  faction  and 
walking  away,  our  approach  requires  the  developer  to  take  the  time  to  develop  at  least  a 
basic  background  story  for  each  and  every  agent  in  the  simulation.  Even  in  our  relatively 
small  example  scenario  of  twenty-eight  agents  it  took  several  hours  to  create  networks  to 
represent  friends,  family,  and  co-workers.  In  a  larger  simulation  this  time  would  increase 
dramatically  unless  tools  are  first  developed  to  aid  the  developer.  The  basic  requirements 
for  such  tools  are  described  in  the  future  work  section  of  this  paper. 
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IV.  SPECIFIC  APPLICATIONS 


A.  INTRODUCTION 

We  identified  two  specific  military  applications  for  our  architecture  in  addition  to 
the  entertainment  based  proof  of  concept  that  we  implemented,  though  we  expect  there  to 
be  many  others  that  we  did  not  address.  We  will  describe  each  application  with  respect 
to  its  user,  interactive  agent  types,  threat  and  location  types,  and  the  applicability  of  using 
our  social  networks  system  to  augment  the  basic  architecture. 

B.  NAVAL  COMBAT  SIMULATION 

The  naval  combat  environment  was  our  original  impetus  for  this  research  and  as 
such  the  architecture  is  well  suited  for  this  particular  application.  The  user  in  this  case 
would  be  a  single  ship  operating  either  on  its  own  or  as  part  of  a  group  of  ships.  This 
allows  for  all  fonns  of  communications  between  actors,  including  everything  from 
flashing  light  to  radio  communication  systems  such  as  Bridge  to  Bridge,  RF,  UHF,  SHF, 
etc.  and  computer  networks  using  email  or  chat. 

Interactions  would  take  place  between  the  user’s  ship  and  other  aircraft  and 
vessels  in  its  vicinity  as  well  as  its  subordinate  and  superior  commands  and  component 
warfare  commanders.  Agent  types  would  include  own  force,  allied,  and  hostile  aircraft 
and  vessels,  commercial  aircraft  and  shipping,  and  orders  passed  from  the  various 
warfare  commanders  such  as  the  Air  Warfare  Commander  (AWC),  Surface  Combatant 
Comander  (SCC),  etc.  Each  agent  type  would  then  have  its  own  set  of  applicable 
sentence  templates  and  phrase  library  so  the  mission  and  dialog  generator 

Threats  would  be  classified  as  any  other  vessel  or  unit  in  the  battlespace  and 
location  types  would  be  defined  according  to  geographic,  political,  or  even  organizational 
boundaries.  For  vessels  a  threat  may  be  any  contact  they  can  detect  using  their  sensor 
systems.  The  dialog  that  could  be  generated  would  be  anything  from  simple  advisories 
telling  other  vessels  to  maintain  situational  awareness  to  calls  for  aid  if  the  vessel  is  under 
attack  or  has  suffered  some  sort  of  casualty.  For  warfare  commanders  the  locations  of 
interest  would  be  a  type  of  battle  space,  for  example,  anything  with  an  elevation  greater 
than  ground  or  sea  level  would  fall  under  the  purview  of  the  AWC.  This  would  also  feed 
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into  which  sentence  template  to  use  as  the  AWC  may  simply  inform  the  user  when  an 
aircraft  is  detected  leaving  an  airbase  in  a  hostile  country,  it  might  also  task  the  unit  to 
fire  upon  that  unit  in  the  case  that  it  is  approaching  a  friendly  vessel  in  international 
waters. 

At  this  level  of  simulation  the  social  networks  system  we  have  described  is  not 
particularly  useful  in  a  simulation  that  takes  place  over  a  short  time  period.  In  a  system 
that  included  a  campaign  style  of  play  such  that  the  actions  a  player  takes  in  one  scenario 
have  lasting  effects  in  subsequent  scenarios,  then  a  network  could  be  described  to  show 
the  attitudes  of  both  allied  and  hostile  forces  and  commanders  towards  the  users  unit. 
This  would  cause  allied  commanders  to  task  a  unit  with  more  important  or  more  sensitive 
missions  depending  upon  the  unit’s  track  record  or  even  cause  enemy  forces  to 
specifically  target  a  unit  if  it  had  caused  them  damage  in  the  past. 

C.  URBAN  ENVIRONMENT  SIMULATION 

A  very  similar  approach  can  be  taken  when  dealing  with  a  simulator  that 
represents  an  urban  environment.  In  this  case  the  user  would  take  the  part  of  a  single 
soldier  or  possibly  a  small  group,  and  the  forms  of  communication  modeled  would  range 
from  electronic  or  radio  communications  with  their  home  base  to  interpersonal 
communications  with  the  various  agents  within  the  city  as  they  move  through  the 
simulated  environment. 

Interactions  would  take  place  between  the  user  and  the  chain  of  command, 
friendly  or  hostile  forces,  or  civilian  entities  present  in  the  game  world.  Because  of  the 
wide  range  of  possible  entity  types,  this  scenario  provides  the  largest  variety  of  sentence 
templates  considering  that  in  many  scenarios  that  are  relevant  to  current  operations. 
Additionally,  there  is  no  guarantee  that  all  of  the  agents  in  the  system  would  speak  in  the 
same  language.  Interactions  would  range  from  receiving  new  objectives  mid-mission,  to 
interrogating  or  otherwise  eliciting  information  from  an  agent,  to  directing  allied  forces  in 
a  combined  operation.  Due  to  the  sheer  number  of  possibilities  for  interaction,  the 
richness  of  the  scenario  would  be  limited  only  by  the  number  of  possibilities  the 
developers  wish  to  explore  and  the  availability  of  subject  matter  experts  in  aiding  them  in 
such  a  scenarios  creation. 
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Threats  would  be  people  and  or  items  of  interest  in  the  battlespace  to  include 
insurgents,  IEDs,  weapons  caches,  etc.  Location  types  could  be  anything  from  specific 
types  of  buildings  such  as  government  offices,  police  stations,  etc.,  to  geographic  regions 
like  neighborhoods  or  a  unit  area  of  responsibility,  to  convoy  routes,  to  complexes  such 
as  military  bases  and  airports.  The  dialog  generated  could  be  the  results  of  an 
interrogation  that  reveals  the  location  of  more  insurgents  or  orders  from  higher  command 
tasking  the  user  to  lead  a  team  to  capture  or  kill  the  insurgents.  Due  to  the  fact  that  these 
various  threats  are  created  at  run  time,  this  provides  a  constantly  changing  environment  in 
which  to  train  in. 

A  social  network  that  takes  into  account  both  allied,  neutral,  and  hostile  forces  in 
the  environment  would  go  a  long  way  towards  modeling  the  fluid  environment  that 
soldiers  find  themselves  in  when  dealing  with  a  counterinsurgency  mission  in  an  urban 
environment.  In  such  multi-faceted  environment,  how  the  user  interacts  with  various 
groups  will  effect  how  willing  they  are  to  deal  with  the  user  later.  It  could  determine  if 
they  willingly  provide  intelligence  or  try  to  kill  the  user  on  sight.  This  can  also  change 
over  time  as  the  line  between  insurgent  and  civilian  continues  to  shift  through  both 
conciliatory  and  inflammatory  actions  on  the  part  of  the  user.  Networks  describing  the 
agents’  families,  work  relationships,  insurgent  groups,  and  relationships  to  the  various 
military  forces  in  the  simulation  would  all  be  useful  in  detennining  their  attitude  towards 
the  user  at  any  specific  time  and  this  would  greatly  enhance  the  simulation  over  the  static 
forces  that  are  more  commonly  modeled. 
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V.  PROOF  OF  CONCEPT 


A.  MISSION  AND  DIALOG  GENERATOR  IMPLEMENTATION 

We  chose  to  implement  the  mission  and  dialog  generator  in  the  context  of  the 
commercial  video  game  Neverwinter  Nights  (NWN).  Initially  we  created  a  small  proof 
of  concept  example  that  consisted  of  three  interactive  agents  each  of  a  different  type,  two 
items  of  interest  and  three  threat  entities. 


The  agents  were  hard  coded  into  the  system  but  the  items  and  threats  were 
randomly  created  upon  scenario  initialization  and  then  replaced  after  a  six  second  wait 
time  (one  system  ‘heartbeat’)  as  the  user  removed  them  from  the  world.  Each  agent  type 
had  varying  location  and  threat  types  that  they  were  interested  in  and  a  set  awareness  of 
their  surroundings  ranging  from  close  to  oblivious  to  perfect  knowledge.  This 
demonstrated  that  the  agents  could  create  dialog  at  run  time  that  accurately  reflected  the 
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items  and  threats  in  the  world  and  that  the  system  could  refresh  itself  over  time  allowing 
for  a  continuous  flow  of  random  threats  and  items  to  constantly  challenge  the  user. 

After  the  prototype  system  was  proven  to  function  as  expected,  we  expanded  the 
system  to  a  scenario  that  includes  a  village  and  the  surrounding  countryside.  We 
increased  the  number  of  interactive  agents  to  twenty-eight  and  included  three  item 
locations  and  nine  threat  entities  that  again  were  randomly  created  at  runtime.  This  larger 
scenario  was  created  to  show  that  the  system  was  scalable.  It  also  was  developed  to  show 
the  time  advantage  that  came  from  multiple  agents  of  the  same  type.  In  the  initial 
scenario  it  was  not  obvious  because  each  of  the  agents  were  of  a  different  type  so  there 
was  no  reuse  of  the  phrase  libraries  though  they  all  used  the  same  sentence  templates.  In 
the  larger  scenario  our  seven  agent  types  were,  Peasant,  Boy,  Girl,  Priest,  Noble,  Servant, 
and  Soldier.  There  are  at  least  two  of  every  type  and  as  many  as  ten  of  the  peasant  type. 
The  system  handled  this  larger  scenario  without  any  noticeable  degradation  in 
performance. 
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1.  Z-Dialog 

In  order  to  implement  the  system  we  took  advantage  of  a  third  party  module  Z- 
Dialog  which  was  published  on  the  NWN  Code  Vault  web  site  as  freeware.  This  code 
bypasses  the  nonnal  conversation  creation  system  where  each  line  of  dialog  and  user 
response  is  hard-coded  into  the  system  during  scenario  development.  While  this  system 
is  relatively  flexible  allowing  for  various  flags  to  control  how  conversations  change  over 
the  course  of  a  scenario  they  still  were  limited  to  the  options  programmed  in  during 
development.  The  Z-Dialog  module  allows  the  developer  to  call  a  function  that 
programmatically  produces  a  conversation  at  run-time.  The  Z-Dialog  system  requires 
two  variables  to  be  set  in  order  to  function.  First,  a  single  string  variable  called  ‘dialog’ 
with  the  dialog  function  set  as  its  value  to  be  included  in  the  variable  space  of  the 
interactive  agent.  Second,  that  the  conversation  tab  of  the  agents  properties  be  set  to 
‘zdlg  converse’.  The  functionality  provided  by  this  module  was  essential  to  our 
implementation  of  the  architecture  in  NWN  and  we  would  have  had  to  either  create  a 
similar  infrastructure  to  support  our  project  or  find  an  alternate  simulation/game  to  work 
with  had  it  not  been  available. 

2.  Knowledge  Representation 

Each  agent  the  user  can  interact  with  has  two  variables  stored  in  its  variable  space 
during  development.  The  first  variable  was  the  agent  type.  This  allows  the  program  to 
choose  which  sentence  templates  to  use,  which  phrase  library  to  draw  from,  and  the  threat 
and  location  types  that  the  agent  is  concerned  with.  For  our  system  we  chose  to  represent 
this  with  a  simple  integer  ranging  from  zero  to  six  as  we  had  seven  agent  types  in  use. 
The  second  variable  was  the  knowledge  level,  which  represents  how  aware  of  the  world 
space  the  agent  is.  This  number  was  used  when  determining  if  the  agent  was  aware  of 
any  particular  threat  and  was  stored  as  an  integer.  The  range  of  this  variable  was 
arbitrarily  chosen  to  be  between  zero  and  one  hundred  where  zero  is  completely  oblivious 
and  one  hundred  was  perfect  knowledge  of  the  world  space.  Upon  scenario  initialization, 
each  agent  was  queried  for  its  agent  type  and  the  appropriate  list  of  sentence  templates, 
location  concerns,  and  threat  concerns  were  stored  in  the  agent’s  variable  space. 
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3.  Threat  and  Item  Generation 

The  NWN  game  engine  treats  both  monsters,  which  we  chose  as  the  threats  for 
our  scenario,  and  items  as  objects  that  can  be  spawned  at  run  time.  The  function  however 
requires  a  specific  location  that  must  be  set  up  during  scenario  creation.  This 
necessitated  that  we  designate  stationary  waypoints  that  could  be  used  by  the  function 
when  the  various  objects  are  created.  The  waypoints  used  to  spawn  threats  were 
designated  as  ‘spawn  points’  and  named  ‘SPAWNPOINTXXX’  where  XXX  is  a  three- 
digit  number  that  ranges  from  zero  to  the  number  of  threats  required  minus  one. 
Similarly,  the  waypoints  used  to  spawn  items  were  designated  as  ‘item  points’  and  named 
‘ITEMPOINTXXX’  where  XXX  is  a  three-digit  number  that  ranges  from  zero  to  the 
number  of  items  required  minus  one.  Because  of  the  pseudo  object-oriented  approach  of 
the  NWN  game  engine  this  segregation  of  the  two  location  types  is  artificial  and  was 
simply  done  to  ensure  a  certain  number  of  threats  and  items  were  available  for  testing  at 
all  times.  Upon  scenario  initialization,  each  spawn  and  item  point  was  populated  with  the 
appropriate  object  type.  The  threats  and  items  were  chosen  randomly  from  a  list  that  was 
hard-coded  into  the  system  by  the  developer  during  scenario  creation. 

It  is  necessary  to  note  that  it  would  have  been  possible  to  write  the  script  to  look 
for  any  specific  naming  convention  and  create  any  set  of  objects,  even  objects  of 
differing  types,  at  the  waypoints  designated.  For  example,  we  could  have  emulated  the 
numbering  system  above  and  named  the  waypoints  ‘LOCATIONXXX’  and  randomly 
chosen  an  item  or  threat  to  be  placed  at  that  location  as  drawn  from  a  single  combined 
list.  Because  of  the  engine  we  are  still  limited  to  a  finite  predetermined  set  of  locations 
however.  This  restriction  is  peculiar  to  the  engine  however  and  is  not  mandated  by  our 
architecture.  In  fact  the  original  system  we  envisioned  would  randomize  the  location, 
timing,  and  type  of  any  spawned  threat  in  order  to  avoid  the  predictability  issues  that  we 
identified  as  problematic  initially. 

The  waypoints  themselves  have  several  types  of  infonnation  attached  to  them  at 
design  time  to  allow  for  use  later.  First,  it  has  a  Boolean  that  designates  whether  or  not  it 
is  currently  in  use  by  the  system.  Second  there  is  a  timer  value  that  tells  how  many 
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system  heartbeats  need  to  pass  before  creating  an  object  at  this  location.  This  allows  for 
a  simple  check  when  seeing  if  a  waypoint  needs  to  have  an  object  spawned  at  its  location. 
This  check  is  done  by  a  for  loop  that  checks  each  location’s  value  and  calls  the  creation 
function  if  the  value  is  false  and  the  timer  value  is  equal  to  zero.  Initially  these  are  set  to 
False  and  zero  respectively  allowing  the  same  code  that  checks  the  locations  to  be  used  to 
populate  the  world  with  objects  during  scenario  initialization.  Third  it  has  a  location  type 
which  is  represented  as  a  global  integer  constant  assigned  to  it  that  corresponds  to  the 
location  concerns  encoded  on  the  various  agents  according  to  their  agent  type.  Finally, 
each  waypoint  has  multiple  name  values.  We  use  two  in  our  proof  of  concept  but  it  could 
easily  be  more  if  the  scenario  developers  desired  more  variation  in  how  the  locations  are 
described  in  the  agent’s  dialog.  These  name  values  are  normally  a  proper  name  and  a 
generic  name  though  this  varies  in  some  cases.  For  example,  a  waypoint  in  the  middle  of 
a  forest  could  be  described  as  ‘the  Black  Forest’  and  ‘the  forest  west  of  town’.  The  point 
of  this  was  not  so  much  to  standardize  the  naming  of  areas  in  the  game  but  to  avoid 
having  to  specify  two  or  more  names  for  every  location  for  every  agent  type  which 
quickly  becomes  a  large  task  as  more  agent  types  and  waypoints  are  added.  The  number 
would  be  kn  as  opposed  to  knm  where  k  is  the  number  of  name  variations,  n  is  the  number 
of  agent  types,  and  m  is  the  number  of  waypoints  in  the  scenario.  This  would  be  eighteen 
(two  variations  multiplied  by  nine  waypoints)  as  opposed  to  one  hundred  twenty-six  (two 
variations  multiplied  by  nine  waypoints  multiplied  by  seven  agent  types),  and  that’s  just 
in  our  limited  scenario. 

When  the  creation  function  is  called,  be  it  for  a  threat  or  item,  it  performs  the 
same  actions  but  draws  from  different  lists  of  unique  ‘tags’  or  keywords  reserved  by  the 
engine  to  refer  to  specific  instances  of  threat  or  item  objects.  When  created,  the  object 
writes  several  things  to  the  variable  space  of  the  waypoint  at  which  it  is  created.  The 
variables  are  the  object’s  tag,  its  plain  name,  its  type,  and  its  notoriety  level.  An  example 
of  a  tag  is  ‘NW  ORCOOl’  obviously  this  is  not  something  which  would  occurin  nonnal 
conversation  with  the  agents;  therefore,  the  plain  name  is  designated  (‘Ore’  in  this  case). 
The  type  is  used  when  determining  if  agents  are  concerned  with  that  type  of  object. 
Various  object  types  were  enumerated  in  the  setup  and  are  treated  as  integer  constants  by 
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the  scripts  and  are  referred  to  exclusively  by  their  variable  name  in  the  scripts.  The  ore  is 
listed  as  a  MONSTER  so  any  agent  whose  list  of  threat  types  includes  MONSTER  will 
be  concerned  with  the  ore’s  existence  in  the  world.  The  notoriety  level  is  a  simple 
method  for  modeling  how  likely  anyone  is  to  know  of  the  objects  existence.  In  the  case 
of  a  threat  object  it  is  a  measure  of  how  obvious  this  object  is  in  the  environment,  how 
much  a  threat  it  is  to  those  around  it,  and  how  important  it  is  in  the  grand  scheme  of 
things  all  rolled  into  one.  This  value  has  an  arbitrarily  assigned  value  that  ranges 
between  zero  and  one  hundred.  In  the  case  of  the  aforementioned  ore,  the  notoriety  of 
such  a  creature  would  be  moderate  to  low,  possibly  in  the  low  40s,  since  such  creatures 
while  belligerent  are  relatively  easy  to  dispose  of  and  somewhat  common  actors  in 
fantasy  games  like  NWN. 

When  an  object  is  removed  from  the  game  world,  by  being  picked  up  if  it  is  an 
item  or  killed  if  it  is  a  threat,  then  a  removal  script  is  run.  This  removal  script  replaces  all 
of  the  values  assigned  to  the  waypoint  upon  object  creation  with  zeroes,  in  the  case  of 
integers,  or  null  strings  in  the  case  of  strings.  It  assigns  a  value  of  False  to  the  waypoints 
‘in  use’  Boolean  and  randomly  assigns  an  integer  value  to  the  timer  value,  between  one 
and  four  for  items  and  between  one  and  six  for  threats.  A  script  is  run  at  every  heartbeat 
that  first  decrements  the  timer  value  by  one  and  then  checks  if  a  waypoint  is  ready  to 
have  an  object  created  at  it.  Since  the  system  heartbeat  occurs  once  every  six  seconds, 
this  gives  the  player  time  to  move  away  from  the  waypoint  before  it  refreshes.  Any  value 
could  be  assigned  to  the  timer  value  upon  object  removal.  We  chose  random  values  from 
ranges  selected  to  allow  some  variation  while  keeping  the  time  period  short.  Our  goal 
was  to  be  able  to  observe  the  both  that  an  object  of  random  type  was  being  created  and 
that  the  agents  were  able  to  register  this  fact  and  respond  accordingly. 

4.  Mission  and  Dialog  Generator 

When  the  user  initiates  a  conversation  with  an  agent  in  the  game  world,  the  z- 
dialog  module  causes  our  dialog  function  to  be  called.  The  first  screen  that  is  called  up 
shows  a  greeting  that  eventually  was  based  on  the  agent’s  attitude  towards  the  user  and 
offered  several  possible  selections  for  the  user,  such  as  ‘Any  threats?’,  ‘Any  rumors?’, 
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and  ‘Goodbye’.  The  attitude  measure  and  its  effect  was  implemented  later  to  show  our 
work  with  the  social  networks  and  is  further  covered  below,  in  social  networks  section  of 
this  chapter. 


The  ‘Any  threats?’  option  calls  a  function  that  searches  the  world  object  for  any 
threats  in  existence  and  then  subjects  it  to  a  series  of  tests  to  see  if  the  agent  is  not  only 
aware  of  the  object  but  actually  cares  about  its  existence. 


Biggs  McDonald 

Welcome  friend.  (attitude=  0.500000000) 


1.  Any  threats? 

2.  Any  rumors? 

3.  Goodbye. 


^  Biggs  McDonald:  Kill  a  few  nasties  for  me. 

\  Biggs  McDonald:  Welcome  friend.  (attitude=  0.500000000) 


F9 

F10 

F1I 

F12 

Figure  8.  Initial  Welcome  Screen 


To  demonstrate  both  spatial  and  type  concerns,  we  compare  the  lists  of  threat  and 
location  concerns  of  the  agent  to  the  values  of  the  corresponding  variables  as  stored  on 
each  of  the  waypoints.  Finally  if  the  agent’s  concerns  align  with  the  threat  type  and 
location  then  the  creature’s  notoriety  value  is  compared  to  the  agent’s  knowledge  level. 
Since  both  have  values  from  zero  to  one  hundred,  this  comparison  is  implemented  as  a 


29 


value  comparison  where  the  check  is  successful  if  the  agent’s  knowledge  level  is  higher 
than  the  object’s  notoriety  level.  This  is  admittedly  a  naive  model,  but  it  is  enough  for 
our  purpose. 


In  Figures  nine  and  ten,  two  different  conversations  with  agents  of  the  same  type 
are  shown.  In  both  conversations  line  two  says  “2.  Fails  on  Location.”  This  is  included 
to  show  that  while  there  is  a  threat  at  that  location  it  is  not  one  that  the  soldier  agent  type 
is  concerned  with.  The  knowledge  level  of  the  agent  in  Figure  9  is  higher  than  that  of  the 
agent  in  Figure  10.  This  can  be  seen  in  lines  eight  and  nine  where  the  agent  in  Figure  10 
fails  its  knowledge  check. 


Biggs  McDonald 

These  are  the  only  threats  I  know  about... 


1.  There  is  a  Zombie  near  that...uh...the  southern  crossroads. 

2.  Fails  on  Location 

3.  There  is  a  Zombie  over  by  the  Caverns  of  Doom. 

4.  There  is  a  Minotaur  near  that.uh.the  Bucaneer's  Landing. 

5.  There  is  a  Bandit  over  by  the  road  to  Sullivan  Farms. 

6.  There  is  a  Ore  over  by  the  abandonned  watch  tower. 

7.  There  is  a  Zombie  over  by  the  Perry  Bridge. 

8.  There  is  a  an  evil  monster  near  that...uh...the  tower  east  of  town. 

9.  There  is  a  an  evil  monster  near  that.uh.the  Thesisville 
Graveyard. 


w 


\i  Biggs  McDonald:  These  are  the  only  threats  I  know  about... 


Figure  9.  Soldier  Conversation  Part  I 


The  sentence  templates  used  here  are  simple  informative  dialog.  The  template  is 
of  the  form  <INTRO><THREAT><LOCATION>  where: 

<INTRO>  =  “There  is  ” 
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<THREAT>  =  <ACTUAL  NAME>  or  “a  dangerous  creature”  or  “something  evil” 
<LOCATION>=  <LOCATIONl>  or  <LOCATION2> 

The  <ACTUAL  NAME>  variable  is  drawn  from  the  threat  object.  If  the 
knowledge  level  of  the  agent  is  not  high  enough  then  one  of  the  ‘vague’  phrases  stored  on 
the  agent  is  used.  The  <LOCATIONl>  and  <LOCATION2>  variables  are  drawn  from 
the  threat’s  spawn  point.  This  template  results  in  one  of  the  following  sentences: 

“There  is  a  Zombie  near  that. .  .uh. .  .the  southern  crossroads.” 

“There  is  a  Zombie  near  the  crossroads.” 

“There  is  a  dangerous  creature  near  that. .  .uh. .  .the  southern  crossroads.” 

“There  is  a  dangerous  creature  near  the  crossroads.” 

“There  is  something  evil  near  that. .  .uh. .  .the  southern  crossroads.” 

“There  is  something  evil  near  the  crossroads.” 

With  a  set  agent,  location,  and  creature  type  there  are  still  six  possible  ways  for 
the  agent  to  respond  to  a  query  for  information. 
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Luke  Deleon 

These  are  the  only  threats  I  know  about.. 


1.  There  is  a  a  dangerous  creature  near  that...uh...the  southern 
crossroads. 

2.  Fails  on  Location 

3.  There  is  a  a  dangerous  creature  over  by  the  Caverns  of  Doom. 

4.  There  is  a  Minotaur  over  by  the  pirate  ship. 

5.  There  is  a  an  evil  monster  over  by  the  northern  crossroads. 

6.  There  is  a  an  evil  monster  near  that  .uh  .the  old  watch  tower. 

7.  There  is  a  an  evil  monster  near  that  .uh  .the  Perry  Bridge. 

8.  Fails  Knowledge  Check 

9.  Fails  Knowledge  Check 


Figure  10. 


Soldier  Conversation  Part  II 


Once  we  have  determined  that  the  agent  is  both  concerned  about  and  aware  of  the 
threat  we  then  determine  which  sentence  template  to  use.  This  is  done  by  checking 
which  sentence  templates  are  available  to  the  agent  type  and  then,  if  more  than  one  is 
available,  a  random  template  is  chosen.  Many  of  these  sentence  templates  are  analogous 
to  the  various  mission  types  that  appear  in  many  video  games.  An  abbreviated  list  and 


short  description  is  provided  in  Table  1  below. 


Name 

Description 

Defend 

In  these  missions  the  player  is  required  to  protect  a  specified  entity,  item, 
or  location  from  some  sort  of  threat.  This  may  occur  at  a  fixed  location  or 
possibly  while  in  transit  between  two  locations. 

Recon 

In  these  missions  the  player  is  required  to  gather  information  on  a  specified 
entity  or  location. 

Kill 

In  these  missions  the  player  is  required  to  eliminate  a  specified  entity  or 
possibly  group  of  entities. 

“Talk  To” 

In  these  missions  the  player  is  required  to  communicate  with  a  specified 
entity  or  group  of  entities. 

Transport 

In  these  missions  the  player  is  required  to  move  one  or  more  entities  or 
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items  from  one  location  in  the  game  space  to  another. 

Gather 

In  these  missions  the  player  is  required  to  gather  a  certain  number  of  items 
or  entities. 

Complex 

Any  of  the  above  mission  types  may  be  combined  in  multiple-phase 
missions. 

Table  1.  Generic  List  of  Role  Playing  Game  Mission  Types 


This  list  is  not  exhaustive  but  it  covers  the  vast  majority  of  missions  or  quests  that 
a  player  is  likely  to  receive  in  the  course  of  a  game  of  this  type.  In  our  implementation 
we  only  created  three  sentence  templates  to  choose  from.  The  first  simply  informs  the 
player  of  a  threat  saying  something  along  the  lines  of  “There  is  a  ore  at  the  crossroads.” 
This  is  simply  the  agent  providing  information  to  the  player  and  does  not  correspond  to 
one  of  the  enumerated  mission  types.  The  second  goes  as  follows,  “Kill  the  ore  at  the 
crossroads.”  This  is  a  simple  version  of  the  Kill  mission  type.  The  third  follows  the 
following  lines,  “Go  get  the  sword  at  the  shrine.”  This  is  an  example  of  the  Gather 
mission  type  where  the  number  of  required  items  is  one.  As  each  sentence  template  is 
only  available  to  certain  agent  types,  the  phrase  libraries  required  for  those  templates 
need  only  be  built  for  those  agent  types  that  are  capable  of  accessing  the  templates  in 
question. 

The  ‘Any  rumors’  option  performs  essentially  the  same  actions  for  item  type 
objects  that  the  threats  option  does  for  creature  type  objects.  The  two  different  triggering 
phrases  were  chosen  to  allow  the  two  types  to  be  differentiated  during  testing.  As  both 
the  items  and  threats  are  internally  represented  as  objects,  a  generic  function  could  have 
been  used  to  deal  with  both  types  at  once. 

5.  Implementation  Advantages 

This  implementation  also  allows  for  the  rapid  addition  of  new  agents,  agent  types, 
threats,  items,  or  even  missions  to  the  scenario.  This  implementation  really  pays  off 
when  adding  further  functionality  to  a  system  since  in  most  cases  the  costs  for  adding  a 
second  new  agent,  item,  or  conversation  is  close  to  double  that  of  the  first,  triple  for 
adding  a  third,  and  so  on.  Under  our  methodology  the  cumulative  cost  for  adding  new 
objects  becomes  less  when  adding  larger  numbers.  Specific  examples  are  as  follows. 
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To  add  a  new  agent  to  the  scenario  requires  simply  adding  an  agent  avatar  and 
setting  the  conversation  function  in  the  agent’s  attributes  settings  and  assigning  the 
knowledge,  type,  and  dialog  variables.  To  add  the  agent  avatar  is  simple,  using  the  NWN 
toolset:  the  designer  selects  an  avatar  type  and  then  click  on  the  location  on  the  map 
where  the  avatar  is  to  be  placed.  Using  the  standard  method  for  adding  agents  in  NWN 
the  developer  would  still  have  to  add  the  agent  avatar  but  then  he  would  have  to  hardcode 
any  conversations,  including  both  the  agent  and  player  dialog,  for  all  possible  situations. 
This  would  then  remain  static  throughout  the  scenario.  The  developer  could  bypass  this 
step  by  cutting  and  pasting  a  previously  created  conversation  from  another  agent  but  this 
either  results  in  an  identical  conversation  or  time  must  then  be  taken  to  alter  the 
conversation  appropriately.  Either  way,  given  large  numbers  of  agents  of  a  specific  type, 
our  implementation  provides  dynamically  created  conversations  complete  with  real  time 
agent  knowledge  at  a  fraction  of  the  time  required  using  conventional  means. 

To  add  a  new  agent  type  using  the  standard  NWN  method  would  be  exactly  the 
same  as  adding  a  new  agent.  Using  our  methodology,  it  involves  creating  a  new  phrase 
library  with  the  required  phrases  for  any  available  sentence  templates  and  setting  up  the 
list  of  threats,  locations,  and  sentence  templates  that  the  agent  type  is  concerned  with. 
This  overhead  is  more  work  than  is  required  in  the  standard  method  but  it  quickly 
becomes  worth  the  effort  as  more  and  more  agents  of  that  type  are  created  in  the  scenario. 

The  addition  of  new  threats  or  items  to  the  scenario  using  the  standard 
methodology  is  done  in  much  the  same  way  as  adding  an  agent.  The  developer  selects  a 
threat  or  item  and  places  it  in  a  static  location.  Any  references  to  the  new  threat  or  item 
must  then  be  manually  added  to  the  conversations  of  any  agent  the  developer  wishes  the 
player  to  be  able  to  gather  infonnation  from.  With  our  implementation  this  process 
becomes  trivial.  The  developer  adds  the  name,  tag,  notoriety,  and  type  values  to  the 
creation  functions.  Creation  and  placement  of  threats  and  items  and  their  inclusion  in 
interactions  with  agents  is  now  taken  care  of  by  the  system  itself  with  no  further  work 
done  by  the  developer. 

In  the  standard  methodology,  to  add  new  mission  types  or  other  interactions  the 

developer  must  manually  update  each  agent’s  conversation.  Our  implementation 
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significantly  reduces  the  time  necessary  to  do  this  in  a  large  system.  In  the  conversation 
creation  function  the  developer  adds  a  new  sentence  template  and  then  adds  the  ability  to 
access  that  template  to  the  appropriate  agent  types.  This  effectually  modifies  the 
conversations  of  every  agent  of  the  required  type  with  a  single  change  to  the  code. 

B.  SOCIAL  NETWORKS  IMPLEMENTATION 

Initially  we  developed  a  basic  three-person  environment  to  test  our  model  using  a 
Python  script  to  perfonn  the  required  calculations.  This  implementation  had  two  basic 
flaws:  the  matrix  and  event  vectors  were  both  hard-coded  and  memory-less  and  the  three- 
person  model  was  too  small  for  all  the  most  basic  scenarios.  We  decided  to  try  an 
implementation  using  a  spreadsheet  instead.  The  spreadsheet  approach  allowed  us  to 
solve  all  of  the  problems  mentioned  above  with  minimal  programming  effort. 


Using  the  spreadsheet  we  developed  a  five-person  environment  with  persons  A, 
B,  C,  D,  and  E.  Using  the  same  group  of  eight  events  we  examined  their  effects  on  seven 
test  cases  that  were  variations  of  the  A  and  B  matrices  of  this  five-person  environment. 
After  this  analysis,  we  then  expanded  our  matrix  to  reflect  the  twenty-eight  people  that 
populated  the  village  in  our  scenario  and  their  relationships.  Notice  that  the  events  are 
designed  to  show  that  the  effects  are  symmetrical  across  the  test  matrices  given  positive 
and  negative  events  in  the  same  and  diametrically  opposed  positions.  In  most  cases  we 
used  our  maximum  and  minimum  values  to  show  the  largest  possible  values  in  the 
resulting  attitude  change  vectors. 
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Since  the  values  in  our  event  vectors  are  bounded  between  negative  and  positive 
one,  positive  one  represents  an  extremely  good  effect  such  as  the  person  winning  millions 
in  the  lottery  the  same  day  as  they  marry  their  high  school  sweetheart,  while  a  negative 
one  would  be  having  their  dog  run  over  by  their  wife  as  she  leaves  him  for  his  best 
friend... or  living  through  the  events  described  in  any  country  song.  As  such,  event  one 
shows  an  event  that  has  a  dramatic  good  effect  on  entity  A.  Event  two  is  a  dramatic 
negative  effect  on  entity  A.  Events  three  and  four  are  the  same  except  the  effect  is  on 
entity  E.  Events  five  and  six  show  an  average  good  or  bad  effect  on  the  entire 
population,  for  example  the  entire  office  getting  a  Christmas  bonus  or  the  whole  office 
coming  down  with  a  nasty  strain  of  the  flu.  Event  seven  has  dramatic  positive  effect  on 
both  entities  A  and  E.  Finally,  event  eight  has  a  dramatic  positive  effect  on  entity  A  and 
a  dramatic  negative  effect  on  event  E. 

1.  Trivial  Case 

The  first  test  case  was  a  trivial  one,  which  consisted  of  fully  connected  graph  in 
which  all  of  the  entities  had  equal  influences  on  each  other  and  themselves.  The  matrices 
are  shown  below  in  Figure  12. 
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Figure  12.  A  and  B  Matrices  for  Trivial  Case 

Using  the  equations  we  derived  in  Chapter  III  we  come  up  with  the  matrix  in 
Figure  13. 
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Figure  13.  Derived  Influence  Matrix  for  Trivial  Case 

When  this  matrix  is  multiplied  by  each  event  vector,  the  attitude  change  vectors 
shown  in  Figure  14  are  produced. 
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Figure  14.  Attitude  Change  Vectors  for  Trivial  Case 


This  case  was  used  to  show  that  our  equations  passed  a  basic  commonsense  test. 
As  expected,  in  events  one,  two,  three,  and  four  the  person  who  was  directly  affected  had 
the  most  change  in  their  attitude.  Since  all  relationships  in  the  matrix  are  equal,  events 
one  and  three  and  two  and  four  show  mirror  image  patterns.  In  the  same  way,  events  one 
and  two  and  three  and  four  are  opposites  since  the  events  are  opposites.  Event  seven 
shows  that  the  initial  effects  reinforce  each  other  when  an  event  directly  affects  two  of 
the  entities  in  a  positive  manner.  Event  eight  shows  that  when  two  entities  are  affected  in 
an  opposing  fashion  the  effects  on  the  non-effected  entities  cancel  each  other  out.  The 
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effects  on  entities  B,  C,  and  D  are  miniscule  and  we  believe  that  the  variations  between  D 
and  the  other  two  are  simply  the  results  of  rounding  errors  in  the  process. 

2.  Degenerate  Case 

The  second  test  case  consisted  of  a  degenerate  matrix  that  consisted  two  separate 
groups  in  which  all  of  the  entities  within  a  group  had  equal  influences  on  each  other  and 
themselves,  but  zero  effect  on  the  other  group.  The  matrices  are  shown  below  in  Figure 
15. 
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Figure  15.  A  and  B  Matrices  for  Degenerate  Case 

Using  the  equations  we  derived  in  Chapter  III  we  come  up  with  the  matrix  in 
Figure  16. 
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Figure  16.  Derived  Influence  Matrix  for  Degenerate  Case 

When  this  matrix  is  multiplied  by  each  event  vector,  the  attitude  change  vectors 
shown  in  Figure  17  are  produced. 
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Figure  17.  Attitude  Change  Vectors  for  Degenerate  Case 


This  case  was  used  to  show  that  when  groups  of  entities  had  no  connection  to 
each  other,  the  influence  did  not  spread  from  one  group  to  another.  This  is  specifically 
shown  by  events  one  through  four  and  seven  and  eight. 

3.  Friend  of  a  Friend  Case 

The  third  test  case  consisted  of  a  chain  of  connected  entities  such  that  entity  A 
was  influenced  by  entity  B,  entity  B  is  influenced  by  entities  A  and  C,  entity  C  is 
influenced  by  entities  B  and  D,  entity  D  is  influenced  by  entities  C  and  E,  and  entity  E  is 
influenced  by  entity  D.  The  matrices  are  shown  below  in  Figure  18. 
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Figure  18.  A  and  B  Matrices  for  Friend  of  a  Friend  Case 
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Using  the  equations  we  derived  in  Chapter  III  we  come  up  with  the  matrix  in 
Figure  19. 
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0.273 

0.057 

0.012 

0.002 

0.136 

0.683 

0.142 

0.031 

0.006 

0.028 

0.142 

0.657 

0.142 

0.028 

0.006 

0.031 

0.142 

0.683 

0.136 

0.002 

0.012 

0.057 

0.273 

0.654 

Figure  19.  Derived  Influence  Matrix  for  Friend  of  a  Friend  Case 


When  this  matrix  is  multiplied  by  each  event  vector,  the  attitude  change  vectors 


shown  in  Figure  20  are  produced. 


Event  1  = 


"0.654” 

” -0.654” 

”0.002” 

”-0.002” 

0.136 

-0.136 

0.006 

-0.006 

0.028 

,  Event!  = 

-0.028 

,  Event  3  = 

0.028 

,  Event  4  = 

-0.028 

0.006 

-0.006 

0.136 

-0.136 

0.002_ 

-0.002_ 

0.654  J 

-0.654 

Event  5  = 


"0.5” 

”-0.5 1 

”0.657” 

0.652 

0.5 

-0.5 

0.142 

0.130 

0.5 

,  Event  6  = 

-0.5 

,  Event  7  = 

0.057 

,  Event  8  = 

-3.469e-  18 

0.5 

-0.5 

0.142 

-0.130 

0.5_ 

-0.5  J 

0.657 

-0.652 

Figure  20.  Attitude  Change  Vectors  for  Friend  of  a  Friend  Case 

This  case  shows  the  effects  of  an  event  as  it  gets  progressively  further  from  the 
entity  that  is  directly  affected.  As  expected,  with  only  a  single  chain  of  influences 
connecting  entities  A  and  E,  by  way  of  all  of  the  others,  an  event  that  directly  affects 
entity  A  causes  a  progressively  smaller  change  in  attitude  as  you  move  further  from  the 
directly  affected  entity.  The  symmetry  of  the  matrix  causes  similar  results  to  those 
shown  in  the  trivial  case  in  events  seven  and  eight. 

4.  Hermit  Case 

The  fourth  test  case  consisted  of  four  entities  making  up  a  fully  connected  graph 

and  a  single  almost  isolated  entity.  The  isolated  entity,  entity  A,  is  influenced  by  one  of 
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the  entities  in  the  larger  matrix,  namely  B,  but  no  one,  including  B  is  influenced  by  A. 
This  would  simulate  an  unknown  observer  who  is  concerned  about  how  events  affect 
another  entity.  The  matrices  are  shown  below  in  Figure  2 1 . 


0 

0.4 

0 

0 

0 

0 

0 

0.1 

0.1 

0.1 

0 

0.1 

0 

0.1 

0.1 

0 

0.1 

0.1 

0 

0.1 

0 

0.1 

0.1 

0.1 

0 

0.6 

0 

0 

0 

0 

0.7 

0 

0 

0 

0 

0.7 

0 

0 

0 

0 

0.7 

[  0  0  0  0  0.7  J 

Figure  21.  A  and  B  Matrices  for  Hennit  Case 

Using  the  equations  we  derived  in  Chapter  III  we  come  up  with  the  matrix  in 
Figure  22. 

"0.6  0.290  0.036  0.036  0.036" 

0  0.727  0.090  0.090  0.090 

(/  -  A)lB  =  0  0.090  0.727  0.090  0.090 

0  0.090  0.090  0.727  0.090 

0  0.090  0.090  0.090  0.727 

Figure  22.  Derived  Influence  Matrix  for  Hermit  Case 

When  this  matrix  is  multiplied  by  each  event  vector,  the  attitude  change  vectors 
shown  in  Figure  23  are  produced. 
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"0.6" 

-0.6 

"0.036“ 

“ -0.036“ 

0 

0 

0.090 

-0.090 

Event  1  = 

0 

,  Event!  = 

0 

,  Event  3  = 

0.090 

,  Event  4  = 

-0.090 

0 

0 

0.090 

-0.090 

0 

0 

0.727 

-0.727 

“0.5" 

-0.5 

“0.636“ 

“  0.563  “ 

0.5 

-0.5 

0.090 

-0.090 

Event  5  = 

0.5 

,  Event  6  = 

-0.5 

,  Event  7  = 

0.090 

,  Event  8  = 

-0.090 

0.5 

-0.5 

0.090 

-0.090 

0.5 

-0.5 

0.727 

-0.727 

Figure  23.  Attitude  Change  Vectors  for  Hermit  Case 

This  case  shows  the  effects  of  a  one  way  connection  to  a  larger  matrix.  This  is 
shown  by  the  fact  that  only  entity  A  is  affected  in  events  one  and  two  yet  an  event 
affecting  any  of  the  other  entities  also  affects  entity  A,  albeit  to  a  lesser  extent.  Events 
seven  and  eight  show  the  same  effect  as  both  have  a  positive  direct  effect  on  entity  A  but 
that  effect  is  reinforced  or  partially  negated  by  the  event’s  affects  on  entity  E. 

5.  Man  in  the  Middle  Case 

The  fifth  test  case  consisted  of  a  fully  connected  graph  where  although  all  of  the 
entities  have  positive  feelings  towards  entity  B,  entity  A  and  the  entities  C,  D,  and  E 
dislike  each  other.  The  matrices  are  shown  below  in  Figure  24. 


0 

0.1 

-0.1 

-0.1 

- 

-0.1 

0.1 

0 

0.1 

0.1 

0.1 

A  = 

-0.1 

0.1 

0 

0.1 

0.1 

-0.1 

0.1 

0.1 

0 

0.1 

-0. 1 

0.1 

0.1 

0.1 

0 

“0.6 

0 

0 

0 

0  “ 

0 

0.6 

0 

0 

0 

B  = 

0 

0 

0.6 

0 

0 

0 

0 

0 

0.6 

0 

0 

0 

0 

0  0.6 

Figure  24.  A  and  B  Matrices  for  Man  in  the  Middle  Case 
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Using  the  equations  we  derived  in  chapter  three  we  come  up  with  the  matrix  in 
Figure  25. 


0.626 

0.040 

-0.073 

-0.073 

-0.073 

0.040 

0.626 

0.073 

0.073 

0.073 

-0.073 

0.073 

0.631 

0.086 

0.086 

-0.073 

0.073 

0.086 

0.631 

0.086 

-0.073 

0.073 

0.086 

0.086 

0.631 

Figure  25.  Derived  Influence  Matrix  for  Man  in  the  Middle  Case 

When  this  matrix  is  multiplied  by  each  event  vector,  the  attitude  change  vectors 
shown  in  Figure  26  are  produced. 


“  0.626  " 

-0.626 

“-0.073“ 

“  0.073 

0.040 

-0.040 

0.073 

-0.073 

Event  1  = 

-0.073 

,  Event!  = 

0.073 

,  Event  3  = 

0.086 

,  Event  4  ■■ 

= 

-0.086 

-0.073 

0.073 

0.086 

-0.086 

-0.073 

0.073 

[_  0.631 

-0.631 

“0.223“ 

"-0.223“ 

“0.552“ 

i 

0.699  “ 

0.443 

-0.443 

0.113 

- 

-0.032 

Event  5  = 

0.402 

,  Event  6  = 

-0.402 

,  Event  7  = 

0.013 

,  EventS  = 

- 

-0.159 

0.402 

-0.402 

0.013 

- 

-0.159 

0.402 

-0.402 

0.558 

- 

-0.705 

Figure  26.  Attitude  Change  Vectors  for  Man  in  the  Middle  Case 

This  case  is  the  first  that  shows  entities  with  conflicting  loyalties.  This  is  shown 
by  the  fact  that  any  event  that  has  a  good  affect  for  an  entity  other  than  entity  B  will 
cause  at  least  one  other  entity  to  demonstrate  a  negative  attitude  change.  Similarly,  if  the 
affect  is  negative  then  at  least  one  other  entity  will  demonstrate  a  positive  attitude 
change.  It  should  also  be  noted  that  in  event  seven  the  change  in  attitude  for  entity  B  is 
greater  than  for  a  event  with  a  good  result  for  either  entity  A  or  entity  E  alone  while  all  of 
the  other  entities  had  less  of  an  attitude  increase  due  to  their  dislike  for  each  other. 
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6.  Cult  Leader  Case 

The  sixth  test  case  consisted  of  a  fully  connected  graph  where  all  of  the  entities 
have  strong  positive  feelings  towards  entity  A.  The  other  entities  also  have  low  B  matrix 
values,  which  make  them  more  strongly  affected  by  outside  forces  than  by  direct  effects 
on  themselves.  The  matrices  are  shown  below  in  Figure  27. 


"  0 

0.1 

0.1 

0.1 

O.f 

0.5 

0 

0.1 

0.1 

0.1 

A  = 

0.5 

0.1 

0 

0.1 

0.1 

0.5 

0.1 

0.1 

0 

0.1 

0.5 

0.1 

0.1 

0.1 

0 

"0.6 

0 

0 

0 

0 

0 

0.2 

0 

0 

0 

B  = 

0 

0 

0.2 

0 

0 

0 

0 

0 

0.2 

0 

0 

0 

0 

0 

0.2 

Figure  27.  A  and  B  Matrices  for  Cult  Leader  Case 


Using  the  equations  we  derived  in  Chapter  III  we  come  up  with  the  matrix  in 
Figure  28. 


0.840 

0.040 

0.040 

0.040 

0.040 

0.600 

0.236 

0.054 

0.054 

0.054 

0.600 

0.054 

0.236 

0.054 

0.054 

0.600 

0.054 

0.054 

0.236 

0.054 

0.600 

0.054 

0.054 

0.054 

0.236 

Figure  28.  Derived  Influence  Matrix  for  Cult  Leader  Case 

When  this  matrix  is  multiplied  by  each  event  vector,  the  attitude  change  vectors 
shown  in  Figure  29  are  produced. 
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Event l  = 


Event  5  = 


0.84_ 

"-0.84" 

“  0.04  ' 

"  -0.04  " 

0.6 

-0.6 

0.054 

-0.054 

0.6 

,  Event!  = 

-0.6 

,  Event  3  = 

0.054 

,  Event  4  = 

-0.054 

0.6 

-0.6 

0.054 

-0.054 

0.6 

-0.6  _ 

0.236_ 

-0.236 

o.5  n 

-0.5] 

“  0.88  “ 

'  0.8  “ 

0.5 

-0.5 

0.654 

0.545 

0.5 

,  Event  6  = 

-0.5 

,  Event  7  = 

0.654 

,  EventS  = 

0.545 

0.5 

-0.5 

0.654 

0.545 

0.5_ 

— 0.5  J 

0.836_ 

0.363 

Figure  29.  Attitude  Change  Vectors  for  Cult  Leader  Case 

This  case  shows  the  effects  of  having  low  values  in  the  B  matrix.  Entity  A  is  the 
only  one  with  a  high  value  in  the  B  matrix  so  any  event  that  affects  entity  A  has  extreme 
effects  on  all  of  the  entities.  Conversely,  an  event  that  affects  entity  E  will  have  a 
minimal  effect  on  the  others.  This  is  best  seen  in  event  eight  where  the  event  has  a 
negative  immediate  effect  on  entity  E  but  that  is  overridden  by  the  immediate  positive 
effect  on  entity  A.  Even  entity  E  has  a  positive  attitude  change  despite  the  negative  effect 
on  them  personally. 

7.  Dictator  Case 

The  final  test  case  consisted  of  a  fully  connected  graph  where  all  of  the  entities 
have  strong  negative  feelings  towards  entity  A.  At  the  same  time,  entity  A  has  positive 
feelings  towards  the  other  entities.  The  other  entities  have  low  B  matrix  values,  which 
make  them  more  strongly  affected  by  outside  forces  than  by  their  own  personal  effects 
while  entity  A  has  a  large  B  matrix  value  which  causes  it  to  be  relatively  resistant  to  an 
events  effects  on  another  entity.  The  matrices  are  shown  below  in  Figure  30. 
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0 

0.1 

0.1 

0.1 

0.1 

0.5 

0 

0.1 

0.1 

0.1 

0.5 

0.1 

0 

0.1 

0.1 

0.5 

0.1 

0.1 

0 

0.1 

0.5 

0.1 

0.1 

0.1 

0 

0.6  0  0  0  0 

0  0.2  0  0  0 

B=  0  0  0.2  0  0 

0  0  0  0.2  0 

0  0  0  0  0.2 

Figure  30.  A  and  B  Matrices  for  Dictator  Case 

Using  the  equations  we  derived  in  chapter  three  we  come  up  with  the  matrix  in 
Figure  31. 

"  0.466  0.022  0.022  0.022  0.022' 

-0.333  0.191  0.010  0.010  0.010 

(I  -A)~l  B  =  -0.333  0.010  0.191  0.010  0.010 

-0.333  0.010  0.010  0.191  0.010 

-0.333  0.010  0.010  0.010  0.191 

Figure  3 1 .  Derived  Influence  Matrix  for  Dictator  Case 

When  this  matrix  is  multiplied  by  each  event  vector,  the  attitude  change  vectors 
shown  in  Figure  32  are  produced. 
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“  0.466  “ 

“-0.466“ 

"0.022“ 

- 

-0.022“ 

-0.333 

0.333 

0.010 

- 

-0.010 

Event  1  = 

-0.333 

,  Event  2  = 

0.333 

,  Event  3  = 

0.010 

,  Event  4  = 

- 

-0.010  . 

-0.333 

0.333 

0.010 

- 

-0.010 

-0.333 

0.333 

0.191 

- 

-0.191 

~  0.277  ‘ 

“-0.277" 

f  0.488 

“  0.444 

-0.055 

0.055 

-0.323 

-0.343 

Event  5  = 

-0.055 

,  Event  6  = 

0.055 

,  Event  7  = 

-0.323 

,  Event  8  : 

= 

-0.343 

-0.055 

0.055 

-0.323 

-0.343 

-0.055 

0.055 

-0.141 

-0.525 

Figure  32.  Attitude  Change  Vectors  for  Dictator  Case 

This  case  also  shows  the  effects  of  having  low  values  in  the  B  matrix.  Entity  A  is 
the  only  one  with  a  high  value  in  the  B  matrix  so  any  event  that  affects  entity  A  has 
extreme  effects  on  all  of  the  entities.  It  represents  a  case  where  entity  A  cares  about  the 
populace  but  the  populace  does  not  particularly  like  entity  A.  This  is  shown  in  event 
seven  where  despite  a  positive  initial  effect  on  entity  E  there  is  still  a  net  negative  effect 
on  entities  B,  C,  D,  and  E.  Event  five  and  six  show  this  same  set  of  opposing  effects, 
where  entity  A  is  effected  positively  the  others  are  effected  negatively  and  visa  versa. 

8.  Village  Example 

To  investigate  a  larger  environment  we  used  the  twenty-eight  agents  we  had  built 
as  part  of  the  mission  and  dialog  generator  and  formulated  three  layers  of  social  networks 
that  we  then  combined  to  create  a  consolidated  network  we  could  use  to  verify  that  our 
model  was  scalable.  The  three  matrices  we  created  represented  the  entities  family 
relationships,  their  work  relationships,  and  their  friend  and  foe  relationships.  The  matrix 
showing  the  family  relationships  is  shown  in  Figure  33. 
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Pennyworth,  Giles 
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Stog,  Trevor 

o.oo| 1.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

0.00  0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Stog,  Lucy 

1.00  0.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

0.00  0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  Grammy 

0.00  0.00 

0.00 

0.33 

0.33 

0.17  0.17 

0.00 

0.00  0.0'  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  Gram  pa 

0.00  0.00 

0.25 

0.00 

0 

0.25  0.25 

0.00 

0.00  0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  Sally 

0.00  0.00 

0.25 

0.25 

0.00 

0.25  0.25 

0.00 

0.00  0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  George 

0.00  0.00 

0.10 

0.10 

0.40 

0.00  0.40 

0.00 

0.00  0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  Eugene 

0.00  1 0.00 

-0.40 

-0.10 

0.30 

0.20  0,00 

0.00 

0.00  0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Longfeather,  Remy 

0.00  0.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

10.00  0.00  0.00 

0.00 

0.00 

0.00 

0.00^ 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Young,  Greg 

0.00  0.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

0.00  1.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Young,  Nancy 

io.oo  0.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

1.00  jo  00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

McDonalc,  Biggs 

0.00  0.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

0.00  0.0c  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Cablness,  Wedge 

0.00  0.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

0.00  0.0'  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Beavers,  Han 

0.00  0.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

0.00  0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Deleon,  Luke 

0.00  0.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

0.00  0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Horton,  Tim 

0.00  0.00 

0.00 

0.00 

0.00 

0.00  0.00 

0.00 

0.00  0.00  0.00 

0.00 
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Figure  33.  Family  Matrix 


The  family  matrix  shows  the  influence  the  various  members  of  each  entity’s 
family  have  on  the  entity  that  corresponds  to  the  row  in  the  matrix.  The  matrix  showing 


the  entities  work  relationships  is  shown  in  Figure  34. 
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Figure  34.  Work  Matrix 


The  work  matrix  shows  the  how  each  entity  is  related  to  each  of  the  others 
concerning  their  work  environment.  We  created  groups  to  represent  soldiers,  priests, 


48 


children  and  their  teachers,  nobility,  etc.  The  matrix  we  developed  to  represent  the 


entities  friend  and  foe  relationships  is  shown  in  Figure  35. 
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Figure  35.  Friend  and  Foe  Matrix 


The  friend  and  foe  matrix  shows  the  relationships  that  the  people  in  our  village 
have  with  each  other.  This  matrix  covers  everything  that’s  not  covered  by  the  other  two. 
Using  the  linear  weighting  algorithm  we  described  in  chapter  three,  the  previous  three 
matrices  were  combined  to  create  a  single  matrix  as  shown  in  Figure  36.  The  weighting 
values  for  each  entity  are  listed  in  the  last  four  columns.  Due  to  conflicting  signs  in  the 
matrices  that  make  up  the  weighted  matrix  some  of  the  values  cancel  out.  This  made  it 
necessary  to  normalize  the  values  in  the  matrix  so  the  summation  of  the  absolute  value  of 
each  of  the  values  in  each  of  the  rows  in  our  A  matrix  added  up  to  one. 
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Figure  36. 
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The  resulting  A  matrix  is  shown  in  Figure  37. 
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0.06 

0.29 

0.00 

0.04 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

-0.05 

0.00 

0.00 

0.00 

0.00 

0.00 

Deleon,  Luke 

0.11 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

-0.02 

0.00 

0.21 

0.14 

0.14 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.08 

0.00 

0.00 

0.00 

0.00 

Horton,  Tim 

-0.03 

0.00 

0.00 

0.02 

0.00 

0.04 

0.00 

0.02 

0.02 

0.00 

-0.01 

0.00 

0.00 

-0.01 

0.00 

0.22 

0.11 

0.11 

0.11 

0.00 

0.00 

-0.02 

0.00 

0.00 

0.00 

0.07 

0.00 

Horton,  Becca 

0.03 

0.07 

-0.06 

0.00 

0.00 

0.03 

0.07 

0.00 

0.03 

0.03 

0.00 

0.00 

0.00 

0.00 

0.03 

0.00 

0.09 

0.09 

0.09 

-0.02 

0.01 

0.00 

0.00 

0.03 

0.05 

0.03 

0.00 

Horton,  Dan 

0.00 

0.00 

0.00 

0.00 

0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.12 

0.06 

0.00 

0.19 

0.08 

0.00 

0.00 

0.00 

0.00 

0.01 

0.00 

0.00 

0.13 

Horton,  Brandon 

0.00 

0.00 

0.00 

0.00 

0.03 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.04 

0.02 

0.17 

0.00 

0.03 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.32 

Horton,  Susan 

0.00 

0.00 

0.00 

0.00 

0.27 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.12 

0.24 

-0.01 

-0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

0.05 

0.00 

0.00 

0.00 

Pennyworth,  Giles 

0.00 

0.01 

0.03 

0.02 

0.00 

0.00 

0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.01 

0.00 

0.00 

0.00 

0.00 

0.26 

0.00 

0.00 

0.00 

0.01 

0.02 

0.03 

Pennyworth,  Jasmine 

0.00 

-0.02 

-0.02 

-0.03 

0.00 

0.00 

-0.02 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.02 

0.00 

0.00 

0.00 

0.31 

0.00 

0.00 

0.00 

0.00 

0.01 

0.03 

0.13 

Darken,  Rudy 

0.00 

0.00 

0.00 

0.08 

0.00 

0.00 

0.00 

-0.05 

0.00 

0.01 

0.00 

0.00 

0.00 

0.00 

0.01 

0.00 

-0.01 

-0.01 

0.00 

0.00 

0.00 

0.00 

0.06 

0.06 

0.00 

0.00 

0.00 

Darken,  Chris 

0.00 

0.00 

0.00 

0.00 

0.00 

0.02 

0.00 

0.00 

-0.04 

0.00 

-0.01 

-0.01 

-0.01 

-0.01 

0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.15 

0.00 

0.17 

0.00 

0.01 

0.00 

Darken,  Patricia 

0.00 

0.00 

0.00 

0.00 

0.13 

0.00 

0.00 

0.00 

0.03 

0.03 

0.00 

0.00 

0.00 

0.00 

0.00 

0.13 

0.03 

0.03 

0.03 

0.00 

0.00 

0.19 

-0.11 

0.00 

0.00 

0.00 

0.05 

Dulaney,  Kate 

0.00 

0.06 

-0.01 

0.00 

0.00 

0.00 

-0.04 

0.00 

0.02 

0.02 

0.00 

0.00 

0.00 

0.00 

0.02 

0.04 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.06 

0.14 

Dulaney,  Jared 

-0.12 

0.00 

0.00 

0.00 

0.00 

0.02 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.10 

0.06 

0.00 

0.00 

0.00 

0.02 

0.02 

0.00 

0.00 

0.00 

0.10 

0.00 

0.08 

Dulaney,  Lana 

0.00 

0.00 

0.00 

0.00 

0.05 

0.06 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.05 

0.14 

-0.02 

0.00 

0.00 

0.00 

0.00 

0.01 

0.18 

0.18 

0.00 

Figure  37.  A  Matrix 


The  resulting  B  matrix  is  shown  in  Figure  38. 
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{B> 

Stog,  Trevor 

0.30 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Stog,  Lucy 

0.00 

0.30 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  Grammy 

0.00 

0.00 

0.30 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  Gram  pa 

0.00 

0.00 

0.00 

0.20 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  Sally 

0.00 

0.00 

0.00 

0.00 

0.20 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  George 

0.00 

0.00 

0.00 

0.00 

0.00 

0.10 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Moses,  Eugene 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.30 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Longfeather,  Remy 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.70 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Young,  Greg 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.30 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Young,  Nancy 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.30 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

McDonald,  Biggs 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

o.so 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Cablness,  wedge 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.50 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Beavers,  Han 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.40 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Deleon,  Luke 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.30 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Horton,  Tim 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.20 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Horton,  Becca 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.20 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Horton,  Dan 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.40 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Horton,  Brandon 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.40 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Horton,  Susan 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.30 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Pennyworth,  Giles 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.60 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Pennyworth,  Jasmine 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.40 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Darken,  Rudy 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.70 

0.00 

0.00 

0.00 

0.00 

0.00 

Darken,  Chris 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.50 

0.00 

0.00 

0.00 

0.00 

Darken,  Patricia 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.25 

0.00 

0.00 

0.00 

Dulaney,  Kate 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.60 

0.00 

0.00 

Dulaney,  Jared 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.50 

0.00 

Dulaney,  Lana 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.30 

Figure  38.  B  Matrix 


Following  the  same  procedure  as  we  did  with  the  five-person  examples  we 


derived  the  influence  matrix  shown  in  Figure  39. 


1NV{1-A}B 

Stog,  Trevor 

0.34 

0.14 

0.00 

0.00 

0.02 

0.01 

0.01 

0.00 

0.02 

0.03 

0.02 

0.01 

0.01 

0.01 

0.01 

0.01 

0.01 

0.01 

0.01 

0.00 

0.00 

-0.05 

0.00 

0.00 

0.04 

-0.01 

0.01 

Stog,  Lucy 

0.10 

0.35 

-0.01 

0.00 

0.02 

0.00 

0.01 

0.00 

0.03 

0.05 

0.01 

0.01 

0.00 

0.00 

0.01 

0.01 

0.00 

0.01 

0.01 

0.01 

0.01 

-0.04 

0.00 

0.00 

0.10 

0.01 

0.02 

Moses,  Grammy 

0.00 

0.01 

0.31 

0.04 

0.06 

0.02 

0.05 

0.00 

0.01 

0.01 

0.00 

0.00 

0.00 

0.00 

0.01 

0.00 

0.01 

0.01 

0.02 

-0.01 

0.00 

0.01 

0.00 

0.01 

-0.01 

0.02 

0.02 

Moses,  Grampa 

0.00 

0.01 

0.03 

0.21 

0.05 

0.02 

0.06 

-0.02 

0.01 

0.03 

0.00 

0.00 

0.00 

0.00 

0.01 

0.01 

0.01 

0.01 

0.02 

0.01 

0.01 

0.04 

0.01 

0.01 

0.02 

0.02 

0.02 

Moses,  Sally 

0.00 

0.01 

0.03 

0.03 

0.23 

0.02 

0.05 

0.00 

0.01 

0.01 

0.00 

0.00 

0.00 

0.00 

0.01 

0.01 

0.00 

0.01 

0.05 

0.00 

0.00 

0.01 

0.00 

0.02 

0.03 

0.03 

0.06 

Moses,  George 

-0.03 

0.00 

0.00 

0.02 

0.05 

0.11 

0.08 

0.00 

0.02 

0.02 

0.00 

0.00 

0.00 

0.00 

0.02 

0.01 

0.01 

0.01 

0.02 

0.00 

0.00 

-0.02 

0.03 

0.01 

0.02 

0.06 

0.02 

Moses,  Eugene 

0.01 

0.03 

-0.09 

-0.02 

0.01 

0.00 

0.29 

0.00 

-0.01 

-0.02 

0.00 

0.00 

0.00 

0.00 

0.00 

-0.01 

0.00 

0.00 

0.00 

0.01 

0.01 

-0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

Longfeather,  Remy 

0.00 

0.00 

0.00 

-0.01 

0.00 

0.00 

0.00 

0.70 

0.01 

-0.03 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.01 

0.04 

0.00 

0.00 

0.00 

0.00 

Young,  Greg 

0.01 

0.02 

0.00 

0.00 

0.00 

0.00 

0.00 

0.01 

0.40 

0.22 

0.04 

0.02 

0.02 

0.02 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

-0.02 

-0.02 

0.01 

0.03 

0.00 

0.00 

Young,  Nancy 

0.01 

0.03 

-0.01 

0.01 

0.01 

0.00 

0.00 

-0.01 

0.19 

0.41 

0.02 

0.01 

0.01 

0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

-0.01 

-0.01 

0.01 

0.05 

0.01 

0.01 

McDonald,  Biggs 

0.03 

0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.02 

0.01 

0.55 

0.08 

0.06 

0.10 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

-0.01 

-0.01 

0.00 

0.00 

0.00 

0.00 

Cablness,  wedge 

0.02 

0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.03 

0.02 

0.09 

0.55 

0.09 

0.06 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

-0.02 

-0.02 

0.00 

0.00 

0.00 

0.00 

Beavers,  Han 

0.03 

0.01 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.06 

0.03 

0.07 

0.17 

0.44 

0.04 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 
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Figure  39 

I. 

Derived  Matrix:  (I-A' 

■‘B 

The  matrix  was  then  multiplied  by  our  test  events  (u)  resulting  in  the  attitude 


change  vectors  (x)  shown  in  Figure  40.  By  comparing  the  expectations  we  drew  from  the 
A  matrix  shown  above  to  the  resulting  attitude  change  vectors  we  were  able  to  determine 
whether  our  model  predicted  as  we  thought  it  should.  This  style  of  analysis  is  admittedly 
anecdotal  and  inherently  imprecise  but  we  simply  wished  to  apply  a  common  sense  test  to 
our  initial  findings  before  pursuing  the  research  further. 
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Figure  40.  Event  and  Attitude  Change  Vectors 


In  the  first  seven  cases  the  model  seems  to  have  performed  according  to  our 
expectations.  In  each  of  the  events  the  resulting  attitude  changes  fit  our  expectations  and 
any  variations  could  be  explained  by  examining  the  original  A  matrix  we  developed.  The 
eighth  case  however  broke  our  model.  The  “Skid”  or  ‘Save  the  Kid’  scenario  has  a  large 
direct  positive  effect  on  Lana  Dulaney,  a  child  in  the  Dulaney  family.  The  narrative 
behind  this  case  was  that  the  user  saved  the  child’s  life  in  the  face  of  some  peril.  The 
inconsistency  we  found  was  that  a  greater  attitude  change  occurred  in  Dan  Horton  and 
Brandon  Horton,  two  of  Lana’s  friends,  than  in  Lana’s  parents.  We  believe  this  to  be  the 
result  of  two  factors.  Lirst  since  the  summation  of  the  absolute  value  of  any  rows 
elements  must  equal  to  one,  the  effect  on  the  adults  is  lessened  since  the  parents  have 
more  connections  in  their  various  networks  and  the  smaller  social  circles  of  the  children 
cause  larger  effects  in  them.  An  alternative  explanation  that  does  not  fault  the  model  is 
that  the  event  may  have  been  badly  formed.  An  event  like  saving  the  child’s  life  should 
perhaps  have  a  strong  direct  effect  on  the  parents  as  well. 
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VI.  CONCLUSIONS  AND  FUTURE  WORK 


A.  CONCLUSIONS 

Our  mission  and  dialog  generator  is  a  generic  architecture  that  can  be  used  to 
extend  the  number  of  repetitions  that  a  simulation  or  game  can  be  used  before  it  becomes 
predictable.  By  randomizing  or  even  better  yet  creating  a  probability  distribution  to 
govern  the  time  and  location  of  emerging  threats,  the  number  of  unique  repetitions 
possible  is  staggering.  Given  agents  of  various  types  and  even  a  limited  number  of 
sentence  templates  representing  various  mission  types  the  possibilities  increase  manifold. 
The  proposed  architecture  also  increases  the  amount  of  code  reuse  and  therefore  reduces 
the  time  and  monetary  costs  required  for  development  or  the  addition  of  new 
functionality.  This  is  especially  true  in  large  systems  since  the  savings  that  come  from 
our  architecture  are  even  more  so  in  larger  systems.  With  smaller  systems  our 
architecture  loses  these  advantages  but  remains  highly  versatile  and  less  predictable  than 
more  conventional  approaches. 

We  have  identified  what  we  believe  to  be  a  major  limitation  of  our  system;  it 
suffers  from  a  lack  of  individuality  among  the  agents.  Other  than  preprogrammed  names 
the  system  has  no  way  to  distinguish  between  individuals  and  especially  in  the  urban 
environment  this  would  be  useful  in  discussing  items  that  are  person  specific.  We 
suggest  that  a  combination  of  our  approach  and  the  standard  methodology  might  be 
useful  in  solving  this  problem. 

As  far  as  our  analysis  of  our  social  networks  model  went,  we  have  shown  that  it 
could  plausibly  be  used  to  model  complex  social  interactions  in  a  simulation.  We 
proposed  it  to  augment  our  dialog  generator  but  other  applications  could  be  imagined. 
The  main  problem  with  our  solution  is  the  complexity  required  to  fully  implement  it.  As 
opposed  to  the  current  practice  of  using  overarching  factions  our  system  requires  the 
developer  to  put  much  greater  thought  into  the  creation  of  the  simulation  or  game 
environment. 
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Both  the  social  networks  and  the  event  creation  requires  the  developer  to  consider 
the  complex  social  and  psychological  interactions  involved  and  in  a  simulation  requiring 
truly  realistic  models,  domain  experts  would  need  to  be  brought  in  to  aid  in  this  aspect  of 
model  development.  To  aid  in  this,  we  believe  that  the  development  of  a  software  tool  to 
allow  non-technical  personnel  to  help  build  these  systems  is  essential.  Our  social 
networks  model  appears  to  be  valid  and  pass  our  common  sense  tests,  but  the  model  still 
requires  a  large  amount  of  work  to  fully  validate  it. 

B.  FUTURE  WORK 

We  propose  the  following  extensions  of  our  research  as  possible  avenues  for 
future  work. 

•  The  mission  and  dialog  generator  was  created  to  be  modular  and  therefore 
allow  for  different  styles  of  speaking  in  the  same  language.  This  works 
because  in  most  cases  the  same  language  uses  similar  grammars.  It  would 
be  interesting  to  extend  the  system  for  use  with  multiple  grammars 
simultaneously. 

•  The  knowledge  level  and  notoriety  level  variables  are  currently  assigned 
manually  and  in  a  largely  arbitrary  manner.  Creating  functions  to 
automate  the  process  would  be  useful. 

o  The  knowledge  variable  could  also  be  divided  into  various 
knowledge  areas  to  represent  the  fact  that  agents  would  tend  to 
have  their  own  areas  of  expertise. 

o  Notoriety  could  be  based  on  location,  intent,  past  actions,  and  even 
have  the  value  rise  over  time  to  model  the  fact  that  more  people 
become  aware  of  its  presence  in  the  game  space. 

•  Modify  the  system  to  allow  for  the  death  and  replacement  of  an  interactive 
agent.  This  could  probably  be  extended  to  allow  for  the  creation  of  agents 
on  the  fly,  further  automating  the  scenario  authoring  process. 

•  A  model  representing  misinformation,  either  intentional  or  unintentional 

would  be  interesting  when  paired  with  the  dialog  generation  system.  This 
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would  allow  for  more  realism  as  certain  missions  may  be  based  on  bad 
intelligence.  A  model  for  information  corruption  as  it  moves  further  away 
from  the  source  of  the  information  (i.e.  telephone  game)  might  also  be 
interesting  to  implement. 

•  The  agent’s  internal  representation  of  the  world  state  is  updated 
instantaneously,  which  is  highly  unrealistic.  The  system  should  be  revised 
to  allow  for  infonnation  transit  time  to  model  the  fact  that  it  would  take 
time  to  learn  of  a  new  threat  or  realize  that  an  old  threat  has  been 
eliminated. 

•  Addition  of  a  temporal  element  to  our  social  networks  model  would  also 
be  interesting. 

•  Experimental  validation  of  the  social  network  model  would  be  interesting 
but  may  incur  several,  if  not  all  of  the  difficulties  described  above. 

•  Expanding  the  network  to  hundreds,  perhaps  thousands  of  entities  would 
be  interesting  especially  if  it  required  spreading  the  simulation  across  a 
network. 

•  As  suggested  above  a  graphical  interface  for  social  network  creation 
would  be  useful,  if  not  necessary  for  working  in  large  scale  simulations 
and  games. 
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